数据准备
创建数据表脚本:
插入数据脚本:(data数据下的_macosx忽略,没用)
大家下载好脚本后,先在MySQL环境中运行create_table.sql
脚本,创建数据表,然后解压下载好的data.zip
,解压后目录如下:
8-10ccf_offline_stage1_train.sql
6-winequality-white.sql
5-8-10ccf_online_stage1_train.sql
4-macro industry.sql
3-ccf_offline_stage1_test_revised.sql
2-winequality-red.sql
1-9income statement.sql
1-9company operating.sql
1-7market data.sql
脚本文件名前面的序号表示用到该数据集的题目序号,例如1-7market data.sql
表示第1题和第7题用到了该数据集。
同样的,这里给大家的也是sql脚本,里面是插入数据的语句,大家只需打开后在MySQL环境中运行即可将数据导入到数据表中。
练习题1:
数据来源:https://tianchi.aliyun.com/dataset/dataDetail?dataId=1074
请使用A股上市公司季度营收预测数据集《Income Statement.xls》和《Company Operating.xlsx》和《Market Data.xlsx》,以Market Data为主表,将三张表中的TICKER_SYMBOL为600383和600048的信息合并在一起。只需要显示以下字段。
取出每张表的对应字段
left join on ticker_symbol 和 end_date
SELECT MarketData.*,
OperatingData.INDIC_NAME_EN,
OperatingData.VALUE,
IncomeStatement.N_INCOME,
IncomeStatement.T_COGS,
IncomeStatement.T_REVENUE
FROM (
SELECT TICKER_SYMBOL,
END_DATE,
CLOSE_PRICE
FROM `market data`
WHERE TICKER_SYMBOL IN ('600383','600048') ) MarketData
LEFT JOIN -- operating data
(SELECT TICKER_SYMBOL,
INDIC_NAME_EN,
END_DATE,
VALUE
FROM `company operating`
WHERE TICKER_SYMBOL IN ('600383','600048') ) OperatingData
ON MarketData.TICKER_SYMBOL = OperatingData.TICKER_SYMBOL
AND MarketData.END_DATE = OperatingData.END_DATE
LEFT JOIN -- income statement
(SELECT DISTINCT TICKER_SYMBOL,
END_DATE,
T_REVENUE,
T_COGS,
N_INCOME
FROM `income statement`
WHERE TICKER_SYMBOL IN ('600383','600048') ) IncomeStatement
ON MarketData.TICKER_SYMBOL = IncomeStatement.TICKER_SYMBOL
AND MarketData.END_DATE = IncomeStatement.END_DATE
ORDER BY MarketData.TICKER_SYMBOL, MarketData.END_DATE;
练习题2:
数据来源:https://tianchi.aliyun.com/dataset/dataDetail?dataId=44
请使用 Wine Quality Data 数据集《winequality-red.csv》,找出 pH=3.03的所有红葡萄酒,然后,对其 citric acid 进行中式排名(相同排名的下一个名次应该是下一个连续的整数值。换句话说,名次之间不应该有“间隔”)
解读
条件1:where ph =3.03
条件2:排名使用dense_rank
select pH ,`citric acid` ,dense_rank () over (order by `citric acid`) rankac
from `winequality-red` wr
where pH = '3.03';
练习题3:
数据来源:https://tianchi.aliyun.com/competition/entrance/231593/information
使用Coupon Usage Data for O2O中的数据集《ccf_offline_stage1_test_revised.csv》,试分别找出在2016年7月期间,发放优惠券总金额最多和发放优惠券张数最多的商家。
这里只考虑满减的金额,不考虑打几折的优惠券。
解读
条件1:年为2016,月份为07,数据只有2016年
条件2:group by merchant_id,sum(amount)
amount 计算 substring_index(discount_rate,":",-1) 最后一个冒号之后的数据
select Merchant_id ,sum( substring_index(Discount_rate,':',-1) ) amount
from ccf_offline_stage1_test_revised costr
where month (Date_received)='07'
group by Merchant_id
ORDER BY cnt DESC
limit 1;
SELECT Merchant_id,COUNT(1) AS cnt
FROM ccf_offline_stage1_test_revised
WHERE Date_received BETWEEN '2016-07-01' AND '2016-07-31'
GROUP BY Merchant_id
ORDER BY cnt DESC
LIMIT 1;
练习题4:
数据来源:https://tianchi.aliyun.com/dataset/dataDetail?dataId=1074
请使用A股上市公司季度营收预测中的数据集《Macro&Industry.xlsx》中的sheet-INDIC_DATA,请计算全社会用电量:第一产业:用电值在2015年用电最高峰是发生在哪月?并且相比去年同期增长/减少了多少个百分比?
select PERIOD_DATE
from `macro industry` mi
where year (PERIOD_DATE)=2015
and indic_id = '2020101522'
group by PERIOD_DATE
order by DATA_VALUE desc
limit 1;
SELECT BaseData.*,
(BaseData.FianlValue - YoY.FianlValue) / YoY.FianlValue YoY
FROM (SELECT PERIOD_DATE,
MAX(DATA_VALUE) FianlValue
FROM `macro industry`
WHERE INDIC_ID = '2020101522'
AND YEAR(PERIOD_DATE) = 2015
GROUP BY PERIOD_DATE
ORDER BY FianlValue DESC
LIMIT 1) BaseData
LEFT JOIN -- YOY
(SELECT PERIOD_DATE,
MAX(DATA_VALUE) FianlValue
FROM `macro industry`
WHERE INDIC_ID = '2020101522'
AND YEAR(PERIOD_DATE) = 2014
GROUP BY PERIOD_DATE ) YoY
ON MONTH(BaseData.PERIOD_DATE) = MONTH(YoY.PERIOD_DATE);
练习题5:
数据来源:https://tianchi.aliyun.com/competition/entrance/231593/information
使用Coupon Usage Data for O2O中的数据集《ccf_online_stage1_train.csv》,试统计在2016年6月期间,线上总体优惠券弃用率为多少?并找出优惠券弃用率最高的商家。
弃用率 = 被领券但未使用的优惠券张数 / 总的被领取优惠券张数
--线上总体优惠券弃用率为多少?
SELECT SUM(CASE WHEN Date='0000-00-00' AND Coupon_id IS NOT NULL
THEN 1
ELSE 0
END) /
SUM(CASE WHEN Coupon_id IS NOT NULL
THEN 1
ELSE 0
END) AS discard_rate
FROM ccf_online_stage1_train
WHERE Date_received BETWEEN '2016-06-01' AND '2016-06-30';
SELECT Merchant_id,
SUM(CASE WHEN Date is null AND Coupon_id IS NOT NULL
THEN 1
ELSE 0
END) /
SUM(CASE WHEN Coupon_id IS NOT NULL
THEN 1
ELSE 0
END) AS discard_rate
FROM ccf_online_stage1_train
WHERE Date_received BETWEEN '2016-06-01' AND '2016-06-30'
GROUP BY Merchant_id
ORDER BY discard_rate DESC
LIMIT 1;
练习题6:
数据来源:https://tianchi.aliyun.com/dataset/dataDetail?dataId=44
请使用 Wine Quality Data 数据集《winequality-white.csv》,找出 pH=3.63的所有白葡萄酒,然后,对其 residual sugar 量进行英式排名(非连续的排名)
select pH ,`residual sugar` ,dense_rank () over(order by `residual sugar`) rankr
from `winequality-white` ww
where pH = 3.63;
练习题7:
数据来源:https://tianchi.aliyun.com/dataset/dataDetail?dataId=1074
请使用A股上市公司季度营收预测中的数据集《Market Data.xlsx》中的sheet-DATA,
计算截止到2018年底,市值最大的三个行业是哪些?以及这三个行业里市值最大的三个公司是哪些?(每个行业找出前三大的公司,即一共要找出9个)
SELECT TYPE_NAME_CN,
SUM(MARKET_VALUE)
FROM `market data`
WHERE END_DATE = '2018-5-31'
GROUP BY TYPE_NAME_CN
ORDER BY SUM(MARKET_VALUE) DESC
LIMIT 3;
练习题8:
数据来源:https://tianchi.aliyun.com/competition/entrance/231593/information
使用Coupon Usage Data for O2O中的数据集《ccf_online_stage1_train.csv》和《ccf_offline_stage1_train.csv》,试找出在2016年6月期间,线上线下累计优惠券使用次数最多的顾客。
SELECT User_id,
SUM(couponCount) couponCount
FROM (SELECT User_id,
count(*) couponCount
FROM `ccf_online_stage1_train`
WHERE (Date is not null
AND Coupon_id is not null)
AND (LEFT(DATE,4)=2016 )
GROUP BY User_id
UNION ALL
SELECT User_id,
COUNT(*) couponCount
FROM `ccf_offline_stage1_train`
WHERE (Date is not null
AND Coupon_id is not null)
AND (LEFT(DATE,4)=2016 )
GROUP BY User_id ) BaseData
GROUP BY User_id
ORDER BY SUM(couponCount) DESC
LIMIT 1;
;
练习题9:
数据来源:https://tianchi.aliyun.com/dataset/dataDetail?dataId=1074
请使用A股上市公司季度营收预测数据集《Income Statement.xls》中的sheet-General Business和《Company Operating.xlsx》中的sheet-EN。
找出在数据集所有年份中,按季度统计,白云机场旅客吞吐量最高的那一季度对应的净利润是多少?(注意,是单季度对应的净利润,非累计净利润。)
SELECT *
FROM (SELECT TICKER_SYMBOL,
YEAR(END_DATE) Year,
QUARTER(END_DATE) QUARTER,
SUM(VALUE) Amount
FROM `company operating`
WHERE INDIC_NAME_EN = 'Baiyun Airport:Passenger throughput'
GROUP BY TICKER_SYMBOL,YEAR(END_DATE),QUARTER(END_DATE)
ORDER BY SUM(VALUE) DESC
LIMIT 1 ) BaseData
LEFT JOIN -- income statement
(SELECT TICKER_SYMBOL,
YEAR(END_DATE) Year,
QUARTER(END_DATE) QUARTER,
SUM(N_INCOME) Amount
FROM `income statement`
GROUP BY TICKER_SYMBOL,YEAR(END_DATE),QUARTER(END_DATE) ) Income
ON BaseData.TICKER_SYMBOL = Income.TICKER_SYMBOL
AND BaseData.Year = Income.Year
AND BaseData.QUARTER = Income.QUARTER;
练习题10:
数据来源:https://tianchi.aliyun.com/competition/entrance/231593/information
使用Coupon Usage Data for O2O中的数据集《ccf_online_stage1_train.csv》和《ccf_offline_stage1_train.csv》,试找出在2016年6月期间,线上线下累计被使用优惠券满减最多的前3名商家。
比如商家A,消费者A在其中使用了一张200减50的,消费者B使用了一张30减1的,那么商家A累计被使用优惠券满减51元。
select Merchant_id,sum( substring_index(discount_rate,":",-1) ) sum1
from
(select Merchant_id,Discount_rate
from ccf_offline_stage1_train cost
where year(`Date`) = 2016
and Discount_rate is not null
and month (`Date`)= 6
and Coupon_id is not null
union all
select Merchant_id ,Discount_rate
from ccf_online_stage1_train cost2
where year(`Date`) = 2016
and month (`Date`)= 6
and Discount_rate is not null
and Coupon_id is not null ) all1
group by merchant_id
order by sum1 desc
limit 1;