Skip to content

LocalData Provider

Compare
Choose a tag to compare
@ianhelle ianhelle released this 22 May 02:47

New Features

  • db86480:
    • LocalDataDriver for using CSV and pickled DF files as a QueryProvider (#64)
      This is primary for demonstration and test purposes where you do not have access to online data sources. It
      replicates the functionality of QueryProvider allowing drop-in replacement in existing notebooks.
    • Updated DataQueries.rst ReadtheDocs page with new queries
    • Add documentation for LocalDataDriver to DataProviders.rst and updated section on creating query files.
  • 66a66d2:
    • Checked in notebook to create DataQueries.rst
    • Added "AzureSentinel" alias for LogAnalytics DataEnvironment

Breaking Changes

  • db86480:
    • Removed deprecated kql.py, query_builtin_queries, query_mgr.py, query_schema.py
    • Changed location of query_defns.py and made pkg reference updates in several modules and notebooks.
    • Some fixes to support local_data_driver in query_store.py, driver_base.py and data_providers.py
    • Unit test - test_localdata_queries.yaml and supporting data and query files.
    • Fixed test in test_utils.py to work on Linux
    • Reduced warnings produced during pytest run to something more reasonable (mainly by removing
      deprecated code
  • 8a32ad5:
    • Changed tilookup and kql_base/kql_driver so that handling failure to load is a bit friendlier. E.g. running
      TILookup in a non-IPython environment (with ASTI provider) will now just cause a warning, not an exception.
    • kql_driver.py also updated to check for get_ipython() returning None and output friendlier message.
    • Changed driver_base.py and derived class to take additional QuerySource parameter for query() method -
      not yet used but required so that we can implement driver-specific checks on query parameters.