realKfiros by realKfiros · Pull Request #269 · tempestphp/100-million-row-challenge

Commits on Mar 12, 2026

Implement basic CSV parsing and JSON output generation in `Parser`.
realKfiros
committed
Refactor `Parser` to use constants for URI prefix and date length; improve CSV parsing logic.
realKfiros
committed
Simplify visit count logic in `Parser` by removing redundant checks.
realKfiros
committed
Refactor `Parser` to improve visit aggregation by introducing key separation and restructuring output logic.
realKfiros
committed
Merge branch 'tempestphp:main' into main
realKfiros
authored
Refactor `Parser` to extract JSON writing logic into a dedicated `writeJson` method for improved clarity and reusability.
realKfiros
committed
Refactor `Parser` to streamline parsing logic by introducing static properties and modularizing visit count, grouping, and JSON writing into dedicated methods.
realKfiros
committed
Simplify JSON writing in `Parser` by replacing `writeJson` method with a direct `file_put_contents` call.
realKfiros
committed
Introduce date-to-ID mapping in `Parser` for optimizing visit aggregation and JSON output generation.
realKfiros
committed
Refactor `Parser` to optimize visit counting and JSON output generation by introducing chunk-based processing, path discovery, and modularized methods.
realKfiros
committed
Refactor `Parser` to replace `discoverPaths` with `getKnownPaths` for improved efficiency and modularity, leveraging `Visit::all()` for path retrieval.
realKfiros
committed
Refactor `Parser` to optimize chunk processing, enhance date registry caching, streamline line handling, and simplify visit aggregation logic.
realKfiros
committed
Refactor `Parser` to use `JSON_PRETTY_PRINT` instead of `JSON_UNESCAPED_SLASHES` for improved JSON readability.
realKfiros
committed

Commits on Mar 13, 2026

Commits on Mar 14, 2026

Commits on Mar 15, 2026

Refactor `Parser` by modularizing `buildDateList` and `buildPathMap`, simplifying visit counting with cached maps, and improving JSON output generation.
realKfiros
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

realKfiros#269

realKfiros#269
realKfiros wants to merge 22 commits into
tempestphp:mainfrom
realKfiros:main

Commits on Mar 12, 2026

Implement basic CSV parsing and JSON output generation in `Parser`.

Refactor `Parser` to use constants for URI prefix and date length; improve CSV parsing logic.

Simplify visit count logic in `Parser` by removing redundant checks.

Refactor `Parser` to improve visit aggregation by introducing key separation and restructuring output logic.

Merge branch 'tempestphp:main' into main

Refactor `Parser` to extract JSON writing logic into a dedicated `writeJson` method for improved clarity and reusability.

Refactor `Parser` to streamline parsing logic by introducing static properties and modularizing visit count, grouping, and JSON writing into dedicated methods.

Simplify JSON writing in `Parser` by replacing `writeJson` method with a direct `file_put_contents` call.

Introduce date-to-ID mapping in `Parser` for optimizing visit aggregation and JSON output generation.

Refactor `Parser` to optimize visit counting and JSON output generation by introducing chunk-based processing, path discovery, and modularized methods.

Refactor `Parser` to replace `discoverPaths` with `getKnownPaths` for improved efficiency and modularity, leveraging `Visit::all()` for path retrieval.

Refactor `Parser` to optimize chunk processing, enhance date registry caching, streamline line handling, and simplify visit aggregation logic.

Refactor `Parser` to use `JSON_PRETTY_PRINT` instead of `JSON_UNESCAPED_SLASHES` for improved JSON readability.

Commits on Mar 13, 2026

Fix validation problems - change the order of the known paths in the json so they would be in the order of the csv and not alphanetically, change to 4 spaces instead of tabs and remove the last line

Extreme tryhard mode! Refactor `Parser` to simplify date handling, optimize visit counting, and modularize path discovery logic.

Bug fixed - check for non null specifically because otherwise it won't count the earliest date as its id is 0 which is "empty" in php

Disable garbage collection in `Parser::parse` to improve performance during date list processing.

Optimize `Parser` by introducing year offsets for faster date computations and refining path and visit counting logic.

Commits on Mar 14, 2026

Refactor `Parser` by replacing `discoverPaths` with `buildKnownPaths`, optimizing visit counting, and improving JSON output to maintain CSV order.

Refactor `Parser` to enhance date handling by introducing `date_id_map`, optimize visit counting with cached path-base lookup, and improve error handling during file processing.

Cleanup some leftovers

Commits on Mar 15, 2026

Refactor `Parser` by modularizing `buildDateList` and `buildPathMap`, simplifying visit counting with cached maps, and improving JSON output generation.