Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add function to read data stream (tabular) #1

Open
rufuspollock opened this issue Jun 21, 2015 · 2 comments
Open

Add function to read data stream (tabular) #1

rufuspollock opened this issue Jun 21, 2015 · 2 comments

Comments

@rufuspollock
Copy link
Contributor

Purpose of function is to data type mapping so raw CSV becomes stream of "objects" with property values having right types.

i.e. csv

name,amount,date
jones,1.82,2015-06-22

becomes

{
  name: "jones",
  amount: 1.82
  date: Date(2015,06,22)
}

Note: same kind of streaming support should be there as in the underlying csv library.

@pwalsh
Copy link

pwalsh commented Jun 21, 2015

Shouldn't we add this as a streaming interface to infer in json-table-schema, rather than in datapackage-read?

Current infer there is just a direct port from Python.

Maybe what you are asking for here is not exactly the same use case as what we designed infer around. In any event, it seems a "streaming infer" belongs to the json-table-schema package, rather that datapackage-read.

@rufuspollock
Copy link
Contributor Author

@pwalsh i think you are probably right - probably better in jts stuff.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants