2012联邦选举委员会数据库中赞助人和赞助模式的分析统计

最新推荐文章于 2023-07-12 11:16:06 发布
最新推荐文章于 2023-07-12 11:16:06 发布
阅读量597 收藏 3
点赞数 1
分类专栏： python 文章标签： python 数据分析 大数据
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/p1306252/article/details/106587364
版权

本例为《利用Python进行数据分析》中第九章最后一节实例，数据来源Github
https://github.com/wesm/pydata-book/tree/2nd-edition/datasets/fec

#2012联邦选举委员会数据库中赞助人和赞助模式的分析统计
import pandas as pd
import numpy as np
from pandas import Series,DataFrame
from numpy.random import randn,rand
import matplotlib.pyplot as plt

fec=pd.read_csv('P00000001-ALL.csv')
fec.head()

D:\application_setup\Anaconda\lib\site-packages\IPython\core\interactiveshell.py:3063: DtypeWarning: Columns (6) have mixed types.Specify dtype option on import or set low_memory=False.
  interactivity=interactivity, compiler=compiler, result=result)
cmte_idcand_idcand_nmcontbr_nmcontbr_citycontbr_stcontbr_zipcontbr_employercontbr_occupationcontb_receipt_amtcontb_receipt_dtreceipt_descmemo_cdmemo_textform_tpfile_num
0C00410118P20002978Bachmann, MichelleHARVEY, WILLIAMMOBILEAL3.6601e+08RETIREDRETIRED250.020-JUN-11NaNNaNNaNSA17A736166
1C00410118P20002978Bachmann, MichelleHARVEY, WILLIAMMOBILEAL3.6601e+08RETIREDRETIRED50.023-JUN-11NaNNaNNaNSA17A736166
2C00410118P20002978Bachmann, MichelleSMITH, LANIERLANETTAL3.68633e+08INFORMATION REQUESTEDINFORMATION REQUESTED250.005-JUL-11NaNNaNNaNSA17A749073
3C00410118P20002978Bachmann, MichelleBLEVINS, DARONDAPIGGOTTAR7.24548e+08NONERETIRED250.001-AUG-11NaNNaNNaNSA17A749073
4C00410118P20002978Bachmann, MichelleWARDENBURG, HAROLDHOT SPRINGS NATIONAR7.19016e+08NONERETIRED300.020-JUN-11NaNNaNNaNSA17A736166
fec.columns

Index(['cmte_id', 'cand_id', 'cand_nm', 'contbr_nm', 'contbr_city',
       'contbr_st', 'contbr_zip', 'contbr_employer', 'contbr_occupation',
       'contb_receipt_amt', 'contb_receipt_dt', 'receipt_desc', 'memo_cd',
       'memo_text', 'form_tp', 'file_num'],
      dtype='object')

fec.iloc[123456]

cmte_id                             C00431445
cand_id                             P80003338
cand_nm                         Obama, Barack
contbr_nm                         ELLMAN, IRA
contbr_city                             TEMPE
contbr_st                                  AZ
contbr_zip                          852816719
contbr_employer      ARIZONA STATE UNIVERSITY
contbr_occupation                   PROFESSOR
contb_receipt_amt                          50
contb_receipt_dt                    01-DEC-11
receipt_desc                              NaN
memo_cd                                   NaN
memo_text                                 NaN
form_tp                                 SA17A
file_num                               772372
Name: 123456, dtype: object

unique_cands=fec.cand_nm.unique()

unique_cands

array(['Bachmann, Michelle', 'Romney, Mitt', 'Obama, Barack',
       "Roemer, Charles E. 'Buddy' III", 'Pawlenty, Timothy',
       'Johnson, Gary Earl', 'Paul, Ron', 'Santorum, Rick',
       'Cain, Herman', 'Gingrich, Newt', 'McCotter, Thaddeus G',
       'Huntsman, Jon', 'Perry, Rick'], dtype=object)

unique_cands[2]

'Obama, Barack'

#竞选人所属政党
parties={'Bachmann, Michelle':'Republican','Romney, Mitt':'Republican','Gingrich, Newt':'Republican',
        'Huntsman, Jon':'Republican','Johnson, Gary Earl':'Republican',
        'McCotter, Thaddeus G':'Republican','Obama, Barack':'Democrat',
        'Paul, Ron':'Republican','Pawlenty, Timothy':'Republican',
        'Perry, Rick':'Republican',"Roemer, Charles E. 'Buddy' III":'Republican',
        'Romney, Mitt':'Republican','Santorum, Rick':'Republican'}

#这里出现了一个问题，就是我辛辛苦苦把竞选人匹配党派敲出来以后，一检查，发现#这里出现了一个问题，
#parties字典长度跟unique_cands的长度不匹配，这不是坑爹么，应该是少敲了一个
len(parties)

12

len(unique_cands)

13

cands=[name for name in parties]#取parties字典的key值，以列表推导式形式输出

cands=np.array(cands)


cands

array(['Bachmann, Michelle', 'Romney, Mitt', 'Gingrich, Newt',
       'Huntsman, Jon', 'Johnson, Gary Earl', 'McCotter, Thaddeus G',
       'Obama, Barack', 'Paul, Ron', 'Pawlenty, Timothy', 'Perry, Rick',
       "Roemer, Charles E. 'Buddy' III", 'Santorum, Rick'], dtype='<U30')

#np.in1d()为测试一个数组在另一个数组中的成员资格，
np.in1d(unique_cands,cands)

array([ True,  True,  True,  True,  True,  True,  True,  True, False,
        True,  True,  True,  True])

#np.setdiff1d()集合差函数
np.setdiff1d(unique_cands,unique_cands[np.in1d(unique_cands,cands)])

array(['Cain, Herman'], dtype=object)

#把漏掉的加到parties字典上
parties['Cain, Herman']='Republican'

parties

{'Bachmann, Michelle': 'Republican',
 'Romney, Mitt': 'Republican',
 'Gingrich, Newt': 'Republican',
 'Huntsman, Jon': 'Republican',
 'Johnson, Gary Earl': 'Republican',
 'McCotter, Thaddeus G': 'Republican',
 'Obama, Barack': 'Democrat',
 'Paul, Ron': 'Republican',
 'Pawlenty, Timothy': 'Republican',
 'Perry, Rick': 'Republican',
 "Roemer, Charles E. 'Buddy' III": 'Republican',
 'Santorum, Rick': 'Republican',
 'Cain, Herman': 'Republican'}

#在原数据集上新增党派关系列
fec['party']=fec.cand_nm.map(parties)

fec.head()
cmte_idcand_idcand_nmcontbr_nmcontbr_citycontbr_stcontbr_zipcontbr_employercontbr_occupationcontb_receipt_amtcontb_receipt_dtreceipt_descmemo_cdmemo_textform_tpfile_numparty
0C00410118P20002978Bachmann, MichelleHARVEY, WILLIAMMOBILEAL3.6601e+08RETIREDRETIRED250.020-JUN-11NaNNaNNaNSA17A736166Republican
1C00410118P20002978Bachmann, MichelleHARVEY, WILLIAMMOBILEAL3.6601e+08RETIREDRETIRED50.023-JUN-11NaNNaNNaNSA17A736166Republican
2C00410118P20002978Bachmann, MichelleSMITH, LANIERLANETTAL3.68633e+08INFORMATION REQUESTEDINFORMATION REQUESTED250.005-JUL-11NaNNaNNaNSA17A749073Republican
3C00410118P20002978Bachmann, MichelleBLEVINS, DARONDAPIGGOTTAR7.24548e+08NONERETIRED250.001-AUG-11NaNNaNNaNSA17A749073Republican
4C00410118P20002978Bachmann, MichelleWARDENBURG, HAROLDHOT SPRINGS NATIONAR7.19016e+08NONERETIRED300.020-JUN-11NaNNaNNaNSA17A736166Republican
#该数据赞助也包括退款，及存在负数出资额
(fec.contb_receipt_amt>0).value_counts()

True     991475
False     10256
Name: contb_receipt_amt, dtype: int64

fec.cand_nm.isin(['Obama, Barack','Romney, Mitt'])

0          False
1          False
2          False
3          False
4          False
           ...  
1001726    False
1001727    False
1001728    False
1001729    False
1001730    False
Name: cand_nm, Length: 1001731, dtype: bool

#筛选出只包含指定两位竞选人的赞助信息
fec_mrbo=fec[fec.cand_nm.isin(['Obama, Barack','Romney, Mitt'])]

fec_mrbo.head()
cmte_idcand_idcand_nmcontbr_nmcontbr_citycontbr_stcontbr_zipcontbr_employercontbr_occupationcontb_receipt_amtcontb_receipt_dtreceipt_descmemo_cdmemo_textform_tpfile_numparty
411C00431171P80003353Romney, MittELDERBAUM, WILLIAMDPOAA3.4023e+08US GOVERNMENTFOREIGN SERVICE OFFICER25.001-FEB-12NaNNaNNaNSA17A780124Republican
412C00431171P80003353Romney, MittELDERBAUM, WILLIAMDPOAA3.4023e+08US GOVERNMENTFOREIGN SERVICE OFFICER110.001-FEB-12NaNNaNNaNSA17A780124Republican
413C00431171P80003353Romney, MittCARLSEN, RICHARDAPOAE9.128e+07DEFENSE INTELLIGENCE AGENCYINTELLIGENCE ANALYST250.013-APR-12NaNNaNNaNSA17A785689Republican
414C00431171P80003353Romney, MittDELUCA, PIERREAPOAE9.128e+07CISCOENGINEER30.021-AUG-11NaNNaNNaNSA17A760261Republican
415C00431171P80003353Romney, MittSARGENT, MICHAELAPOAE9.01201e+07RAYTHEON TECHNICAL SERVICES CORPCOMPUTER SYSTEMS ENGINEER100.007-MAR-12NaNNaNNaNSA17A780128Republican
#根据职业和雇主统计赞助信息
occs=fec['contbr_occupation'].unique()

occs

array(['RETIRED', 'INFORMATION REQUESTED', 'RN', ...,
       'SAFETY SALES MANAGER', 'PRESIDENT & GENERAL MANAGER',
       'LONGWALL MAINTENANCE FOREMAN'], dtype=object)

len(fec['contbr_occupation'].unique())

45074

#许多职业都涉及相同的基本工作类型，或者同一样东西有多种变体。清理一些这类的数据
occ_mapping={'INFORMATION REQUESTED':'NOT PROVIDED','INFORMATION REQUESTED PER BEST EFFORTS':'NOT PROVIDED',
            'INFORMATION REQUESTED(BEST EFFORTS)':'NOT PROVIDED','C.E.O.':'CEO'
}

fec.groupby('contbr_occupation')['party'].count()


contbr_occupation
   MIXED-MEDIA ARTIST / STORYTELLER    1
 AREA VICE PRESIDENT                   1
 RESEARCH ASSOCIATE                    1
 TEACHER                               1
 THERAPIST                             3
                                      ..
ZOOKEEPER                              1
ZOOLOGIST                              3
ZOOLOGY EDUCATION                      1
\NONE\                                 1
~                                      1
Name: party, Length: 45073, dtype: int64


#如果没有提供相关映射，返回x
f=lambda x: occ_mapping.get(x,x)
fec.contbr_occupation=fec.contbr_occupation.map(f)


#对雇主信息进行同样的处理
emp_mapping={'INFORMATION REQUESTED PER BEST EFFORTS':'NOT PROVIDED','INFORMATION REQUESTED':'NOT PROVIDED','SELF':'SELF-EMPLOYED','SELF EMPLOYED':'SELF-EMPLOYED'}
#如果没有提供相关的映射，则返回x
f=lambda x:emp_mapping.get(x,x)
fec.contbr_employer=fec.contbr_employer.map(f)

#根据党派和职业对数据进行整合，滤除总出资额不足200万美金的数据
by_occupation=fec.pivot_table(values='contb_receipt_amt',index='contbr_occupation',columns='party',aggfunc='sum')

by_occupation
partyDemocratRepublican
contbr_occupation
MIXED-MEDIA ARTIST / STORYTELLER100.0NaN
AREA VICE PRESIDENT250.0NaN
RESEARCH ASSOCIATE100.0NaN
TEACHER500.0NaN
THERAPIST3900.0NaN
.........
ZOOKEEPER35.0NaN
ZOOLOGIST400.0NaN
ZOOLOGY EDUCATION25.0NaN
\NONE\NaN250.0
~NaN75.0

45071 rows × 2 columns

#过滤掉总出资额不足200万美金的数据
over_2mm=by_occupation[by_occupation.sum(1)>2000000]

over_2mm
partyDemocratRepublican
contbr_occupation
ATTORNEY11126932.977.343540e+06
CEO2071474.793.932686e+06
CONSULTANT2459812.712.472815e+06
ENGINEER950425.551.780102e+06
EXECUTIVE1355161.053.918557e+06
HOMEMAKER4243394.301.324141e+07
INVESTOR884133.002.320349e+06
LAWYER3159391.873.785903e+05
MANAGER762693.221.404878e+06
NOT PROVIDED4849801.961.975207e+07
OWNER998867.362.279621e+06
PHYSICIAN3732387.443.491657e+06
PRESIDENT1878009.954.469834e+06
PROFESSOR2163571.082.944627e+05
REAL ESTATE528752.091.581747e+06
RETIRED25270507.232.290594e+07
SELF-EMPLOYED667393.401.591758e+06
#用直方图来展现更为清晰
over_2mm.plot(kind='barh')

<matplotlib.axes._subplots.AxesSubplot at 0x1700e31efc8>

在这里插入图片描述

#统计对Romney, Mitt和Obama, Barack总出资额最高的职业和企业家

fec_mrbo
cmte_idcand_idcand_nmcontbr_nmcontbr_citycontbr_stcontbr_zipcontbr_employercontbr_occupationcontb_receipt_amtcontb_receipt_dtreceipt_descmemo_cdmemo_textform_tpfile_numparty
411C00431171P80003353Romney, MittELDERBAUM, WILLIAMDPOAA3.4023e+08US GOVERNMENTFOREIGN SERVICE OFFICER25.001-FEB-12NaNNaNNaNSA17A780124Republican
412C00431171P80003353Romney, MittELDERBAUM, WILLIAMDPOAA3.4023e+08US GOVERNMENTFOREIGN SERVICE OFFICER110.001-FEB-12NaNNaNNaNSA17A780124Republican
413C00431171P80003353Romney, MittCARLSEN, RICHARDAPOAE9.128e+07DEFENSE INTELLIGENCE AGENCYINTELLIGENCE ANALYST250.013-APR-12NaNNaNNaNSA17A785689Republican
414C00431171P80003353Romney, MittDELUCA, PIERREAPOAE9.128e+07CISCOENGINEER30.021-AUG-11NaNNaNNaNSA17A760261Republican
415C00431171P80003353Romney, MittSARGENT, MICHAELAPOAE9.01201e+07RAYTHEON TECHNICAL SERVICES CORPCOMPUTER SYSTEMS ENGINEER100.007-MAR-12NaNNaNNaNSA17A780128Republican
......................................................
701381C00431445P80003338Obama, BarackMOUNTS, ROBERTAPOZZ962043077HQ USFK (FKDC-SA)GS-15 INTERNATIONAL RELATIONS OFFICER25.026-FEB-12NaNNaNNaNSA17A787803Democrat
701382C00431445P80003338Obama, BarackTAITANO, TYRONEHAGATNAZZ969323373NOT EMPLOYEDRETIRED250.020-JAN-12NaNNaNNaNSA17A775668Democrat
701383C00431445P80003338Obama, BarackTUCKER, PAMELAAPOZZ963190030DODEAEDUCATOR3.020-JAN-12NaNNaNNaNSA17A775668Democrat
701384C00431445P80003338Obama, BarackMOUNTS, ROBERTAPOZZ962043077HQ USFK (FKDC-SA)GS-15 INTERNATIONAL RELATIONS OFFICER25.026-APR-12NaNNaNNaNSA17A785239Democrat
701385C00431445P80003338Obama, BarackNEAL, AMBERAPOZZ091022065THE DEPARTMENT OF DEFENSE EDUCATION ACTEACHER135.004-SEP-11NaNX* OBAMA VICTORY FUND 2012SA18756218Democrat

700975 rows × 17 columns

grouped=fec_mrbo.groupby('cand_nm')

def get_top_amounts(group,key,n=5):
    totals=group.groupby(key)['contb_receipt_amt'].sum()
    return(totals.sort_values(ascending=False)[:n])
    

grouped.apply(get_top_amounts,'contbr_occupation',n=7)

cand_nm        contbr_occupation
Obama, Barack  RETIRED              25270507.23
               ATTORNEY             11126932.97
               NOT PROVIDED          4849801.96
               HOMEMAKER             4243394.30
               PHYSICIAN             3732387.44
               LAWYER                3159391.87
               CONSULTANT            2459812.71
Romney, Mitt   RETIRED              11266949.23
               NOT PROVIDED         11173374.84
               HOMEMAKER             8037250.86
               ATTORNEY              5302578.82
               PRESIDENT             2403439.77
               CEO                   2247242.03
               EXECUTIVE             2230653.79
Name: contb_receipt_amt, dtype: float64

grouped.apply(get_top_amounts,'contbr_employer',n=10)

cand_nm        contbr_employer   
Obama, Barack  RETIRED               22665902.20
               SELF-EMPLOYED         18584277.16
               NOT EMPLOYED           8584118.70
               NOT PROVIDED           5036178.37
               HOMEMAKER              2599987.04
               STUDENT                 318831.45
               VOLUNTEER               257104.00
               MICROSOFT               215585.36
               SIDLEY AUSTIN LLP       168254.00
               REFUSED                 149516.07
Romney, Mitt   NOT PROVIDED          11827237.12
               RETIRED               11264701.35
               HOMEMAKER              8037000.86
               SELF-EMPLOYED          7265136.53
               STUDENT                 488642.82
               CREDIT SUISSE           265650.00
               MORGAN STANLEY          262266.00
               GOLDMAN SACH & CO.      233250.00
               BARCLAYS CAPITAL        162750.00
               H.I.G. CAPITAL          139500.00
Name: contb_receipt_amt, dtype: float64

#对出资额分组
bins=np.array([0,1,10,100,1000,10000,100000,1000000,10000000])

labels=pd.cut(fec_mrbo.contb_receipt_amt,bins)

labels

411         (10, 100]
412       (100, 1000]
413       (100, 1000]
414         (10, 100]
415         (10, 100]
             ...     
701381      (10, 100]
701382    (100, 1000]
701383        (1, 10]
701384      (10, 100]
701385    (100, 1000]
Name: contb_receipt_amt, Length: 700975, dtype: category
Categories (8, interval[int64]): [(0, 1] < (1, 10] < (10, 100] < (100, 1000] < (1000, 10000] < (10000, 100000] < (100000, 1000000] < (1000000, 10000000]]

grouped=fec_mrbo.groupby(['cand_nm',labels])

grouped.size()

cand_nm        contb_receipt_amt  
Obama, Barack  (0, 1]                    493
               (1, 10]                 40070
               (10, 100]              372280
               (100, 1000]            153991
               (1000, 10000]           22284
               (10000, 100000]             2
               (100000, 1000000]           3
               (1000000, 10000000]         4
Romney, Mitt   (0, 1]                     77
               (1, 10]                  3681
               (10, 100]               31853
               (100, 1000]             43357
               (1000, 10000]           26186
               (10000, 100000]             1
               (100000, 1000000]           0
               (1000000, 10000000]         0
dtype: int64

grouped.size().unstack(0)
cand_nmObama, BarackRomney, Mitt
contb_receipt_amt
(0, 1]49377
(1, 10]400703681
(10, 100]37228031853
(100, 1000]15399143357
(1000, 10000]2228426186
(10000, 100000]21
(100000, 1000000]30
(1000000, 10000000]40
bucket_sums=grouped.contb_receipt_amt.sum()#对出资额求和

bucket_sums

cand_nm        contb_receipt_amt  
Obama, Barack  (0, 1]                      318.24
               (1, 10]                  337267.62
               (10, 100]              20288981.41
               (100, 1000]            54798531.46
               (1000, 10000]          51753705.67
               (10000, 100000]           59100.00
               (100000, 1000000]       1490683.08
               (1000000, 10000000]     7148839.76
Romney, Mitt   (0, 1]                       77.00
               (1, 10]                   29819.66
               (10, 100]               1987783.76
               (100, 1000]            22363381.69
               (1000, 10000]          63942145.42
               (10000, 100000]           12700.00
               (100000, 1000000]              NaN
               (1000000, 10000000]            NaN
Name: contb_receipt_amt, dtype: float64

bucket_sums=bucket_sums.unstack(0)

bucket_sums
cand_nmObama, BarackRomney, Mitt
contb_receipt_amt
(0, 1]318.2477.00
(1, 10]337267.6229819.66
(10, 100]20288981.411987783.76
(100, 1000]54798531.4622363381.69
(1000, 10000]51753705.6763942145.42
(10000, 100000]59100.0012700.00
(100000, 1000000]1490683.08NaN
(1000000, 10000000]7148839.76NaN
normed_sums=bucket_sums.div(bucket_sums.sum(axis=1),axis=0)#在面元内进行规格化

normed_sums
cand_nmObama, BarackRomney, Mitt
contb_receipt_amt
(0, 1]0.8051820.194818
(1, 10]0.9187670.081233
(10, 100]0.9107690.089231
(100, 1000]0.7101760.289824
(1000, 10000]0.4473260.552674
(10000, 100000]0.8231200.176880
(100000, 1000000]1.000000NaN
(1000000, 10000000]1.000000NaN
normed_sums[:-2].plot(kind='barh',stacked=True)

<matplotlib.axes._subplots.AxesSubplot at 0x1700ecfd988>

在这里插入图片描述

#根据州统计赞助信息
grouped=fec_mrbo.groupby(['cand_nm','contbr_st'])

totals=grouped.contb_receipt_amt.sum().unstack(0).fillna(0)

totals=totals[totals.sum(1)>100000]

totals[:10]
cand_nmObama, BarackRomney, Mitt
contbr_st
AK275353.1586204.24
AL537835.48504882.08
AR324802.28105351.50
AZ1484241.841850484.23
CA23370680.8410908232.46
CO2104551.381477810.82
CT2037216.663377421.85
DC4317865.85999740.50
DE325394.1481404.00
FL7138932.528008067.40
percent=totals.div(totals.sum(1),axis=0)

percent
cand_nmObama, BarackRomney, Mitt
contbr_st
AK0.7615750.238425
AL0.5158020.484198
AR0.7550840.244916
AZ0.4450870.554913
CA0.6817800.318220
CO0.5874760.412524
CT0.3762420.623758
DC0.8119940.188006
DE0.7998910.200109
FL0.4713100.528690
GA0.5874900.412510
HI0.8763340.123666
IA0.7413760.258624
ID0.2004240.799576
IL0.8276490.172351
IN0.6225490.377451
KS0.5751670.424833
KY0.5165020.483498
LA0.3578430.642157
MA0.5912560.408744
MD0.7506310.249369
ME0.9105300.089470
MI0.5227050.477295
MN0.8552630.144737
MO0.4951270.504873
MS0.3745930.625407
MT0.6530630.346937
NC0.6558790.344121
NE0.5874310.412569
NH0.5862260.413774
NJ0.4906870.509313
NM0.8441330.155867
NV0.5403620.459638
NY0.5953930.404607
OH0.4894120.510588
OK0.4135490.586451
OR0.6966950.303305
PA0.6618560.338144
PR0.8897720.110228
RI0.7078510.292149
SC0.6105310.389469
SD0.3459480.654052
TN0.4248300.575170
TX0.5185050.481495
UT0.1229480.877052
VA0.5554020.444598
VT0.9461760.053824
WA0.7656340.234366
WI0.8053430.194657
WV0.5738910.426109
WY0.4408230.559177
XX0.0000001.000000
pandas教程：2012 Federal Election Commission Database 2012联邦选举委员会数据库
Cachel Wood的博客
11-28 210
里面包含了支持者的名字，职业和雇主，地址，赞助金额。我们可以已经能想到如何切割、整理数据，来提取赞助者的统计数据，或提取宣传活动的模式，这里我们展示一些不同的分析方法。可以看到有些职业是同一种工作类型，指代的是同一个东西。这两个连续操作是分别独立执行的，一个结束后，另一个才开始。上，这里我是把数据集压缩成了ZIP格式，解压后能正常导入）。我觉得也有必要好好了解一下，这个网站做了很好的讲解，），所以我们最好添加这样的信息。这样的情况，即把两个索引操作连在一起。，发现映射关系被正常执行了，所以这里的。
利用python进行数据分析-数据聚合与分组运算2
zhuhengv的博客
07-14 5038
1.分组级运算和转换 聚合只不过是分组运算的其中一种而已。介绍transform和apply方法，它们能够执行更多其他的分组运算 假设我们想要为一个DataFrame添加一个用于存放各索引分组平均值的列。一个办法是先聚合再合并 print df k1_means=df.groupby('key1').mean().add_prefix('mean_') print k1_means p
美国联邦选举委员会-政治竞选赞助方面的数据集
最新发布
02-12
美国联邦选举委员会-政治竞选赞助方面的数据集。 美国联邦选举委员会发布了有关政治竞选赞助方面的数据。其中包括赞助者的姓名、职业、雇主、地址以及出资额等信息。样本数据量100w条左右。可用于机器学习和数据分析
pandas数据分析小案例：以美国大选数据为例
m0_56676945的博客
02-26 239
用pandas进行数据分析：以美国大选数据为例
Python数据分析案例五：2012联邦选举委员会数据库
qq_41925850的博客
06-27 855
一：介绍 该案例来自《利用Python进行数据分析·第2版》，分析的对象为对2012年美国总统大选的数据集，其中包括赞助者的姓名、职业、雇主、地址以及出资额等信息。 二：分析流程 1：读取数据 fec= pd.read_csv('C:/Users/17322/Desktop/datasets/fec/P00000001-ALL.csv') 2：预处理 （1）添加党派信息 提取候选人名单 uniq...
2012联邦选举委员会数据库
喝醉酒的小白
02-26 3125
读取（CSV格式）文本文件 根据职业和雇主统计赞助信息、对出资额分组和根据州统计赞助信息
2012联邦选举委员会数据分析
simpleye1的博客
03-08 649
本片分析来自于《利用python进行数据分析》，为巩固学习成果，我对其实践了一遍。 import pandas as pd fec = pd.read_csv('datasets/fec/P00000001-ALL.csv') fec.info() #读取文件并查看信息 可以看到这里都是表格的column的名字，cand_nm是选民支持的候选人，但这些列里没有候选人党派的标记，所以我们用Ma...
数据处理实例：2012年联邦选举委员会数据库
m0_52945258的博客
08-05 391
首先 数据下载网站： https://tianchi.aliyun.com/dataset/dataDetail?spm=5176.20895038.0.0.3c736ad9z5Td6r&dataId=2581&userId=1 下载下来数据后，需要对其进行合并，合并方法： data_01 = pd.read_csv('data_01.csv') data_02 = pd.read_csv('data_02.csv') data_03 = pd.read_csv('data_03..
python数据聚合分组实战-----2012联邦选举委员会数据库
热门推荐
洪源的博客
10-20 1万+
目录 数据来源： 根据职业和雇主统计赞助信息 对出资额分组 根据州统计赞助信息 数据来源： https://github.com/wesm/pydata-book &gt;&gt;&gt; fec = pd.read_csv('D:\python\DataAnalysis\data\P00000001-ALL.csv',low_memory = False) &gt;&gt;&gt...
利用Python进行数据分析—2012年联邦选举委员会数据库
GPDee的博客
07-12 81
美国联邦选举委员会公布了有关政治运动贡献的数据。这些数据包括捐赠者姓名、职业和雇主、地址和缴费金额。基于职业的赞助信息统计是另一种经常被研究的统计任务。例如律师们喜欢民主党，企业主喜欢共和党，看数据。在小额赞助方面，奥巴马比较多。
iOS 2015年3月苹果新的审核标准（中文）
jichw的专栏
03-11 7312
请阅读以下许可协议的条款和条件之前仔细下载或使用Apple软件。这些条款和条件构成了您与苹果的法律协议。iOS开发者计划许可协议目的你想用苹果软件（定义见下文）制定的一个或多个应用程序（定义见​​下文），运行iOS和OS关注的苹果品牌产品。苹果愿意给你一个有限的许可使用苹果软件开发和对本协议规定的条款和条件，测试应用程序。本协议项下开发的应用程序可以分布在四个方面：（1）通过App Store，如果
参加民主运动时我们应该拥有数据隐私权
weixin_26636643的博客
08-13 163
Campaign finance disclosures unnecessarily make political supporters vulnerable to physical and cyber attacks. 竞选资金的披露不必要地使政治支持者容易受到物理和网络攻击。 The US Federal Election Commission (FEC) has a data privac...
利用Python进行数据分析第二版复现（十三）_5
ztzxx的博客
02-12 435
实例分析 14.5 2012联邦选举委员会数据库 import pandas as pd import numpy as np fec = pd.read_csv('datasets/fec/P00000001-ALL.csv')#导入数据 fec.info()#查看信息的相关数据描述 E:\anaconda\lib\site-packages\IPython\core\interactive...
2015-04-08-数据聚合与分组运算(3)-透视表和交叉表+2012联邦选举委员会数据库
chenzhenzhu2011的专栏
04-08 1561
--------------------------------------------------------------------------------------- -----(四)、透视表和交叉表 from pandas import DataFrame,Series import numpy as np import pandas as pd cd L:\czz tips
15 Python总结之数据分析与挖掘
Mind_programmonkey的博客
04-18 611
数据分析实例之2012美国联邦选举委员会 美国联邦选举委员会发布了有关政治竞选赞助方面的数据。其中包括赞助者的姓名、职业、雇主、地址以及出资额等信息。 这个数据集中一些特征： contbr_employer:捐款雇主 cand_nm:候选人 contbr_occupation:捐款人职业 contb_receipt_amt:捐款金额 1 前期准备 1.1 使用pandas.read_csv载入数...
数据分析案例--2012美国总统竞选赞助数据分析
Michaelyu的博客
03-12 1622
美国总统竞选赞助数据分析 本文来自阿里云天池实验室，案例原地址 自学数据分析的小王同学借鉴一下，自己写一遍，分析一遍，自己做的代码和结果如下 1.导入相关的python数据分析的库 import pandas as pd import numpy as np import matplotlib.pyplot as plt %matplotlib inline 2.数据载入和总览 2.1由于单个数...
第九章 数据分组与聚合（下）
yunini2的博客
06-27 811
import pandas as pd from pandas import Series fec=pd.read_csv("e:/P00000001-ALL.csv") fec[:2]      cmte_id    cand_id             cand_nm        contbr_nm contbr_city  \ 0  C00410118  P20002978  Bachm
Pandas方法实践-2012美国总统竞选赞助数据分析
qq_43314839的博客
08-27 1454
目录 1. 数据载入和总览 1.1 数据载入(pd.read_csv()) 1.2 数据合并(pd.concat()) 1.3 数据预览和基本统计分析 2. 数据清洗 2.1 缺失值处理​ 2.2 数据转换 利用字典映射进行转换：党派分析 排序：按照职业汇总对赞助总金额进行排序 利用函数进行数据转换：职业与雇主信息分析 2.3 数据筛选 赞助金额筛选 候选人筛选（O...
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值