Skip to content

maxgio92/package-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

package-crawler

A crawler for packages distributed by Linux distros. This is a proof of concept for a multi-stage data processing pipeline in Go.

Disclaimer: this project is in experimental stage.

Quickstart

package-crawler --all PACKAGE_NAME 2>debug.log 1>result.json

Development

Testing

All tests:

go test -tags all_tests ./...

Unit tests

All unit tests:

go test -tags all_unit_tests ./...

Unit tests per feature:

go test -tags unit_tests,packages ./...
go test -tags unit_tests,database ./...
go test -tags unit_tests,repository ./...

Integration tests

All integration tests:

go test -tags all_integration_tests ./...

Integration tests per feature:

go test -tags integration_tests,packages ./...
go test -tags integration_tests,database ./...
go test -tags integration_tests,repository ./...

About

A package crawler for most known Linux distros

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages