Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release v1.0.6 #221

Merged
merged 36 commits into from
Oct 11, 2024
Merged

Release v1.0.6 #221

merged 36 commits into from
Oct 11, 2024

Conversation

hariharan-devarajan
Copy link
Owner

No description provided.

1. We hash the filename and create a metadata event on load.
2. On opening a file, we store the hash instead of the whole value.
3. Use a md5 hash implementation for consistent hashing.
4. Added dftracer_anonymize script to ignore all hash events and anonymize the trace filenames.
5. Support for the end symbol for perfetto was added.
6. Support to have exec and cmd as hash as well.
7. Using H for phase event for hash events.
8. Using M for phase events for metadata events.
9. Added support for core-affinity analysis.
1. Use phase as M events for all
2. Use custom names to understand which event it is.
3. All events are under the dftracer events.
4. We support process events (PR) and Hash events (FILE_HASH, HOST_HASH, and STR_HASH)
5. Add thread name to metadata
* excluding env.
* keep the int in stack till it can freed.
* scope of metadata object
* initialize hash
* increase buffer size.
* make meta dynamic.
* Fix environment variables defaults in the documentation.

* Fix environment variables formatting.
* checks for consistent buffer writing.
* added lock for stack index.
* added lock for map.
* added guard to current index variable
* make tests faster
* stop tracing after finalize.
* check for fd < 0

* fixed readlinkat to handle AT_FDCWD
* update for loading hashed traces
* fix indentation
* switch to uint64
* fixed indentation
* flatten the desk bag.
* changed set index to groupie for removing redundant
* updated example.

---------

Co-authored-by: Hariharan Devarajan <[email protected]>
Co-authored-by: hariharandev1 <[email protected]>
* added APIs for Metadata events.

* fixed api
* add hostnames to metadata.

* added pid tid and hhash column to metadata
* add support for splitting trace

- bump version of dftracer
- implement split trace based on user input

* remove unused import

* added installation parts and docs.

* changes to split script

* fix corner case of small traces

* add sanity check

checking number of lines between split files and original files

* fuxed naming

* add `dftracer_event_count`

- use sqlite from python to calculate valid events inside traces
- reuse `dftracer_event_count` for sanity checking inside
`dftracer_split`

* fix space in docs

* make indexing optional

* fixing remove when there are too many files

* update branch and add sqlite3

* change dftracer_event_count params

* remove logging from pushd and popd

* added changes for testing

* update for multi-threading and printing

* more optimizations.

* added pipelining.

* final commit for checkpointing chunks

---------

Co-authored-by: hariharandev1 <[email protected]>
* use hex string for hash as they will collide otherwise.

* fixed counts.
* Update .readthedocs.yaml
* Update requirements.txt
* multithreaded exclusive lock

* Added validate script
…strings. (#219)

* remove quotes from strings

* ignore multiple characters

* added validation script
@hariharan-devarajan hariharan-devarajan merged commit 335b786 into master Oct 11, 2024
4 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants