python的pandas和numpy_Python-Pandas和Numpy在机器学习分类中的问题

这就是我要做的。原始数据集有两列，一列是个人的全名(即：贾斯汀·戴维森)，另一列是种族(即：英语)。我想用朴素的贝叶斯机器学习方法训练，根据名字特征预测人们的种族。为了从名字中提取名字特征，我将全名分成3个字符的子字符串(例如：Justine Davidson=&gt；jus，ust，sti。。。等等)。以下是我的代码。在import pandas as pd

from pandas import DataFrame

import re

import numpy as np

import nltk

from nltk.classify import NaiveBayesClassifier as nbc

# Get csv file into data frame

data = pd.read_csv("C:\Users\KubiK\Desktop\OddNames_sampleData.csv")

frame = DataFrame(data)

frame.columns = ["name", "ethnicity"]

name = frame.name

ethnicity = frame.ethnicity

# Remove missing ethnicity data cases

index_missEthnic = frame.ethnicity.isnull()

index_missName = frame.name.isnull()

frame2 = frame.loc[~index_missEthnic, :]

frame3 = frame2.loc[~index_missName, :]

# Make all letters into lowercase

frame3.loc[:, "name"] = frame3["name"].str.lower()

frame3.loc[:, "ethnicity"] = frame3["ethnicity"].str.lower()

# Remove all non-alphabetical characters in Name

frame3.loc[:, "name"] = frame3["name"].str.replace(r'[^a-zA-Z\s\-]', '') # Retain space and hyphen

# Replace empty space as "#"

frame3.loc[:, "name"] = frame3["name"].str.replace('[\s]', '#')

# Find the longest name in the dataset

##frame3["name_length"] = frame3["name"].str.len()

##nameLength = frame3.name_length

##print nameLength.max() # Longest name has !!!40 characters!!! including spaces and hyphens

# Add "?" to fill spaces up to 43 characters

frame3["name_filled"] = frame3["name"].str.pad(side="right", width=43, fillchar="?")

# Split into three-character strings

for i in range(1, 41):

substr = "substr" + str(i)

frame3[substr] = frame3["name_filled"].str[i-1:i+2]

# Count number of letter characters

frame3["name_len"] = frame3["name"].map(lambda x : len(re.findall('[a-zA-Z]', x)))

# Count number of vowel letter

frame3["vowel_len"] = frame3["name"].map(lambda x : len(re.findall('[aeiouAEIOU]', x)))

# Count number of consonant letter

frame3["consonant_len"] = frame3["name"].map(lambda x : len(re.findall('[b-df-hj-np-tv-z]', x)))

# Count number of in-between-string (not any) spaces

frame3["space_len"] = frame3["name"].map(lambda x : len(re.findall('[#]', x)))

# Space-name ratio

frame3["SN_ratio"] = frame3["space_len"]/frame3["name_len"]

# Vowel-name ratio

frame3["VN_ratio"] = frame3["vowel_len"]/frame3["name_len"]

# Recategorize ethnicity

frame3["ethnicity2"] = ""

frame3["ethnicity2"][frame3["ethnicity"] == "chinese"] = "chinese"

frame3["ethnicity2"][frame3["ethnicity"] != "chinese"] = "non-chinese"

# Test outputs

##print frame3

# Run naive bayes

featuresets = [((substr1, substr2), ethnicity2) for index, (substr1, substr2, ethnicity2) in frame3.iterrows()]

train_set, test_set = featuresets[:400], featuresets[400:]

classifier = nbc.train(train_set)

# Predict

print classifier.classify(ethnic_features('Anderson Silva'))

Name Ethnicity

J-b'te Letourneau Scotish

Jane Mc-earthar French

Li Chen Chinese

Amabil?? Bonneau English

当我运行这个程序时，它有两个问题：这是一个非致命问题，在整个代码中多次发生，但它仍然在不终止的情况下运行：See the the caveats in the documentation: http://pandas.pydata.org/pandas-docs/stable/indexing.html#indexing-view-versus-copy

frame3["space_len"] = frame3["name"].map(lambda x : len(re.findall('[#]', x)))

C:\Users\KubiK\Desktop\FamSeach_NameHandling4.py:57: SettingWithCopyWarning:

A value is trying to be set on a copy of a slice from a DataFrame.

Try using .loc[row_indexer,col_indexer] = value instead

这是一个致命问题(终止了程序)：Traceback (most recent call last): Traceback (most recent call last):

File "C:\Users\KubiK\Desktop\FamSeach_NameHandling4.py", line 71, in

featuresets = [(substr1, ethnicity2) for index, (substr1, substr2, ethnicity2) in frame3.iterrows()]

ValueError: too many values to unpack