Skip to content

File Conveyor is a daemon written in Python to detect, process and sync files. In particular, it's designed to sync files to CDNs. Amazon S3 and Rackspace Cloud Files, as well as any Origin Pull or FTP Push CDN, are supported. Originally written for my bachelor thesis at Hasselt University in Belgium.

Notifications You must be signed in to change notification settings

chris-blay/fileconveyor

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

326 Commits
 
 
 
 
 
 

Repository files navigation

This is a fork of the excellent fileconveyor by wimleers which allows the
synced_files table to be stored with either sqlite3 or MySQLdb as the
backend. This can be configured in settings.py. The default settings make this
behave just like the original.

I was working on optimizing a high-traffic website by balancing web traffic
across several homogeneous web servers and needed a central place
to store user generated content instead of trying to copy it around to a bunch
of web servers. Fileconveyor works great for sending uploaded files to an FTP
server but then it would only be aware of the file it synced and not those
synced from other web servers.

Perhaps in the future the interactions with the synced_files table could be
moved into an abstract class? Then new backends could easily be added by sub-
classing and the backend could even be configured via config.xml!

The Drupal CDN module was also forked and modified to query MySQL for
synced_files but I didn't do that so I don't have the changes...

About

File Conveyor is a daemon written in Python to detect, process and sync files. In particular, it's designed to sync files to CDNs. Amazon S3 and Rackspace Cloud Files, as well as any Origin Pull or FTP Push CDN, are supported. Originally written for my bachelor thesis at Hasselt University in Belgium.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Python 100.0%