连接PyODPS
from odps import ODPS
o = ODPS(
access_id='',
secret_access_key='',
project='',
endpoint=''
)
返回非结构化数据
with o.execute_sql(
'desc table_name;'
).open_reader() as reader:
print(reader.raw)
返回结构化数据
with o.execute_sql('select * from table_name;').open_reader(tunnel=True) as reader:
for record in reader: # 处理每一个record。
print(record)
出现获取数据超时或获取数据受限等问题,以下两种方法可以解决
1.在脚本中设置options.tunnel.use_instance_tunnel =True
2.设置open_reader(tunnel=True)