Skip to content

IP Geolocation integration

Compare
Choose a tag to compare
@WillTheFarmer WillTheFarmer released this 28 Jan 05:12
· 96 commits to main since this release
  • [3.0.0] This version is NOT backward compatible to previous versions due to many database and process changes. These are final major changes required for Web interface in development.
  • [3.0.0] Integration with MaxMind GeoIP2 Python API to enhance Client IP geolocation data for Log Data Visualization in charts, reports & data analysis interfaces.
  • [3.0.0] modify logs2mysql.py to integrate IP data retrieval process and reorganizing encapsulation of all processes within the same "Import Load Process".
  • [3.0.0] add TABLES log_client_city, log_client_coordinate, log_client_country, log_client_network, log_client_organization and log_client_subdivision for IP geolocation data.
  • [3.0.0] add normalize_client STORED PROCEDURE to normalize IP Address geolocation data into 6 tables.
  • [3.0.0] rename TABLES log_clientname to log_client, log_servername to log_server
  • [3.0.0] rename COLUMNS clientnameid to clientid, servernameid to serverid throughout application tables and processes.
  • [3.0.0] modify process_access_parse and process_error_parse WHERE CLAUSES for server_name UPDATE commands.
  • [3.0.0] add 16 stored functions for primary attribute tables to return names for Slice and dice is a data analysis in drill-down Web interface.
  • [3.0.0] modify and reworded all console log messages in logs2mysql.py to standardize messages for each process. Added COLORS to coordinate message types for better readability.
  • [3.0.0] modify all database INDEX NAMES for standardization and consolidation.
  • [3.0.0] tested simultaneously uploading logs from 10 VPS with multiple VirtualHosts on each Server processing thousands of files in different formats and millions of log records.

Download apache-logs-to-mysql