Refine the way to handle the CSV or other file

[dadiorchen]

Now we are handling the CSV in-memory (string in memory), so maybe we need to use a better way to handle this, especially when the data is big, (maybe stream or so)

[dadiorchen]

treetracker-airflow-dags/lib/capture_export.py

Lines 83 to 98 in 90855ff

	try:
	# convert lines to file like object
	f = io.StringIO("\n".join(lines))
	date = datetime.datetime.now().strftime("%Y%m%d%H%M%S")
	file_name = f"capture_{year_month}.csv"
	r = requests.post('https://dev-ckan.treetracker.org/api/3/action/resource_create',
	data={
	"package_id":"7753e581-6e93-4eb2-8dea-4ca31f0c4d24",
	"url": "http://test.com/sample.csv",
	"name": file_name,
	"format": "CSV",
	},
	headers={"X-CKAN-API-Key": "270a5f9e-9319-4f5a-983c-1fa50087fa2d"},
	files=[('upload', f)]
	# files={'report.xls': f}
	)