Skip to content

Yothalot-PHP 3.0.0
Compare
Choose a tag to compare
@RafalGoslawski RafalGoslawski released this 01 Nov 13:37
· 7 commits to master since this release
v3.0.0
ce70f30
  • prevent exceptions from bubbling up in case a directory does not exist
  • fixed extension to be compatible with updated yothalot library (but added a dependency on unavailable private copernica libraries)
  • updated default config file
  • allow datasize shortcuts (like 1MB) in ini file
  • the yothalot address can now be supplied in amqp:// format in the config file and as parameter to the job instead of supplying all parts individually
  • fixed compile errors
  • fixed wordcount example
  • work in progress on nosql support for the yothalot php extension
  • fixed a couple of todos for directory class
  • work in progress on using nosql for file storage
  • removed weird characters
  • fixed allocation issue
  • we now pass the nosql connection to the writer task, and the job::directory() method now always returns an directory that exists
  • the yothalot.maxcache ini setting is now parsed as human-readable data size (like "1MB")
  • fixed running finalization algorithm in client
  • the input files for writer tasks that are executed by the client are now automatically removed
  • no longer use readdir_r because it is going to be deprecated
  • the nodes now use the same cache settings that were used on the client that started the mapreduce process
  • renamed core class to rabbit class, added cache object to the connection class
  • fixed serialization for connection object
  • the cache settings that are passed to the yothalot connection object are now passed to the actual jobs, they no longer fetch settings from ini file
  • the local running finalizer now uses the cache settings from the connection object
  • cache object no longer holds a target object, because we do not need in in all places
  • the rabbit data is no longer serialized when a job is serialized
  • removed couple of todos
  • cache settings are now passed to the yothalot server
  • better error message
  • internal cancelled property in the tempqueue should be set earlier to prevent double cancels
  • for local finalizing, we need to change to the appropriate output dir
  • removed the TupleHelper class, and refactored it to seperate classes
  • added the RecordReduce class that allows to process records from the logfile directly
Assets 2
Loading