熊猫并将列和数据添加到表中

时间:2020-02-02 20:28:02

标签: python-3.x pandas datatables

任何想法如何将除法(j)添加到每一行?我运行该程序,它遍历每个部门(1至5分部)。我想在每行中添加什么划分。在表格顶部,标题为“姓名,性别,州,职位,研究生,俱乐部/ HS,等级,承诺,部门”。现在,我不知道每行是哪个分区,因为它是空白的。感谢您的帮助。...

import pandas as pd

max_page_num = 10 

with open('results.csv', 'a', newline='') as f:  
    f.write('Name, Gender, State, Position, Grad, Club/HS, Rating, Commitment, Division\n')

def division():
   for j in range(1,5):
      division = str(j)  
      for i in range(max_page_num):  
         print('page:', i)
         graduation = str(2020)
         area = "commitments" # "commitments" or "clubplayer"
         gender = "m" 
         page_num = str(i)
         source = "https://www.topdrawersoccer.com/search/?query=&divisionId=" + division + "&genderId=m&graduationYear=" + graduation + "&playerRating=&pageNo=" + page_num + "&area=" + area +""
         all_tables = pd.read_html(source)
         df = all_tables[0]
         print('items:', len(df))

         df.to_csv('results.csv', header=False, index=False, mode='a') 

division()

1 个答案:

答案 0 :(得分:1)

如果我理解正确,只需添加列“ division”即可。

import pandas as pd

max_page_num = 10 

with open('results.csv', 'a', newline='') as f:  
    f.write('Name, Gender, State, Position, Grad, Club/HS, Rating, Commitment, Division\n')

def division():
   for j in range(1,5):
      division = str(j)  
      for i in range(max_page_num):  
         print('page:', i)
         graduation = str(2020)
         area = "commitments" # "commitments" or "clubplayer"
         gender = "m" 
         page_num = str(i)
         source = "https://www.topdrawersoccer.com/search/?query=&divisionId=" + division + "&genderId=m&graduationYear=" + graduation + "&playerRating=&pageNo=" + page_num + "&area=" + area +""
         all_tables = pd.read_html(source)
         df = all_tables[0]
         df['division'] = division
         print('items:', len(df))

         df.to_csv('results.csv', header=False, index=False, mode='a') 

division()
相关问题