CHANGELOG.md

@vladmandic/human

Version: 3.0.0
Description: Human: AI-powered 3D Face Detection & Rotation Tracking, Face Description & Recognition, Body Pose Tracking, 3D Hand & Finger Tracking, Iris Analysis, Age & Gender & Emotion Prediction, Gesture Recognition

Author: Vladimir Mandic [email protected]
License: MIT
Repository: https://github.com/vladmandic/human

Changelog

HEAD -> main 2022/11/18 [email protected]

• cleanup git history
• default empty result
• refactor draw and models namespaces
• refactor distance
• add basic anthropometry
• added webcam id specification
• include external typedefs
• prepare external typedefs
• rebuild all
• include project files for types
• architectural improvements
• refresh dependencies
• add named exports
• add draw label templates
• reduce dev dependencies
• tensor rank strong typechecks
• rebuild dependencies

2.11.1 2022/10/09 [email protected]

• add rvm segmentation model
• add human.webcam methods
• create funding.yml
• fix rotation interpolation

2.10.3 2022/09/21 [email protected]

• add human.video method

2.10.2 2022/09/11 [email protected]

• add node.js esm compatibility (#292)
• release

2.10.1 2022/09/07 [email protected]

• release candidate
• add config flags
• test update
• release preview
• optimize startup sequence
• reorder backend init code
• test embedding
• embedding test
• add browser iife tests
• minor bug fixes and increased test coverage
• extend release tests
• add model load exception handling
• add softwarekernels config option
• expand type safety
• full eslint rule rewrite

2.9.4 2022/08/20 [email protected]

• add browser test
• add tensorflow library detection
• fix wasm detection
• enumerate additional models
• release refresh

2.9.3 2022/08/10 [email protected]

• rehault testing framework
• release refresh
• add insightface

2.9.2 2022/08/08 [email protected]

• release rebuild

2.9.1 2022/07/25 [email protected]

• full rebuild
• release cleanup
• tflite experiments
• add load monitor test
• beta for upcoming major release
• swtich to release version of tfjs
• placeholder for face contours
• improve face compare in main demo
• add webview support
• fix(gear): ensure gear.modelpath is used for loadmodel()
• npm default install should be prod only
• fix npm v7 compatibility
• add getmodelstats method
• rebuild
• release build

2.8.1 2022/06/08 [email protected]

• webgpu and wasm optimizations
• add faceboxes prototype
• full rebuild

2.7.4 2022/05/24 [email protected]

2.7.3 2022/05/24 [email protected]

• add face.mesh.keepinvalid config flag
• initial work for new facemesh model

2.7.2 2022/05/12 [email protected]

• fix demo when used with video files
• major release

2.7.1 2022/05/09 [email protected]

• support 4k input
• add attention draw methods
• fix coloring function
• enable precompile as part of warmup
• prepare release beta
• change default face crop
• beta release 2.7
• refactor draw methods
• implement face attention model
• add electronjs demo
• rebuild

2.6.5 2022/04/01 [email protected]

• bundle offscreencanvas types
• prototype precompile pass
• fix changelog generation
• fix indexdb config check

2.6.4 2022/02/27 [email protected]

• fix types typo
• refresh
• add config option wasmplatformfetch

2.6.3 2022/02/10 [email protected]

• rebuild

2.6.2 2022/02/07 [email protected]

• release rebuild

2.6.1 2022/01/20 [email protected]

• implement model caching using indexdb
• prototype global fetch handler
• fix face box and hand tracking when in front of face

2.5.8 2022/01/14 [email protected]

• fix samples
• fix(src): typo
• change on how face box is calculated

2.5.7 2021/12/27 [email protected]

• fix posenet
• release refresh

2.5.6 2021/12/15 [email protected]

• strong type for string enums
• rebuild
• fix node detection in electron environment

2.5.5 2021/12/01 [email protected]

• added human-motion
• add offscreencanvas typedefs
• release preview
• fix face box scaling on detection
• cleanup

2.5.4 2021/11/22 [email protected]

• prototype blazepose detector
• minor fixes
• add body 3d interpolation
• edit blazepose keypoints
• new build process

2.5.3 2021/11/18 [email protected]

• create typedef rollup
• optimize centernet
• cache frequent tf constants
• add extra face rotation prior to mesh
• release 2.5.2
• improve error handling

2.5.2 2021/11/14 [email protected]

• fix mobilefacenet module
• fix gear and ssrnet modules
• fix for face crop when mesh is disabled
• implement optional face masking
• add similarity score range normalization
• add faceid demo
• documentation overhaul
• auto tensor shape and channels handling
• disable use of path2d in node
• add liveness module and facerecognition demo
• initial version of facerecognition demo
• rebuild
• add type defs when working with relative path imports
• disable humangl backend if webgl 1.0 is detected
• add additional hand gestures

2.5.1 2021/11/08 [email protected]

• new human.compare api
• added links to release notes
• new frame change detection algorithm
• add histogram equalization
• implement wasm missing ops
• performance and memory optimizations
• fix react compatibility issues
• improve box rescaling for all modules
• improve precision using wasm backend
• refactor predict with execute
• patch tfjs type defs
• start 2.5 major version
• build and docs cleanup
• fix firefox bug

2.4.3 2021/10/28 [email protected]

• additional human.performance counters

2.4.2 2021/10/27 [email protected]

• add ts demo
• switch from es2018 to es2020 for main build
• switch to custom tfjs for demos
• release 2.4

2.4.1 2021/10/25 [email protected]

• refactoring plus jsdoc comments
• increase face similarity match resolution
• time based caching
• turn on minification
• initial work on skiptime
• added generic types
• enhanced typing exports
• add optional autodetected custom wasm path

2.3.6 2021/10/21 [email protected]

• fix for human.draw labels and typedefs
• refactor human.env to a class type
• add human.custom.esm using custom tfjs build

2.3.5 2021/10/19 [email protected]

• removed direct usage of performance.now

2.3.4 2021/10/19 [email protected]

• minor blazepose optimizations
• compress samples
• remove posenet from default package
• enhanced movenet postprocessing
• use transferrable buffer for worker messages
• add optional anti-spoofing module
• add node-match advanced example using worker thread pool
• package updates
• optimize image preprocessing
• set webgpu optimized flags
• major precision improvements to movenet and handtrack
• image processing fixes
• redesign body and hand caching and interpolation
• demo default config cleanup
• improve gaze and face angle visualizations in draw
• release 2.3.1

2.3.1 2021/10/06 [email protected]

• workaround for chrome offscreencanvas bug
• fix backend conflict in webworker
• add blazepose v2 and add annotations to body results
• fix backend order initialization
• added docker notes
• breaking change: new similarity and match methods
• tweaked default values
• enable handtrack as default model
• redesign face processing
• refactoring
• define app specific types
• implement box caching for movenet
• autodetect number of bodies and hands
• upload new samples
• new samples gallery and major code folder restructure
• new release

2.2.3 2021/09/24 [email protected]

• optimize model loading
• support segmentation for nodejs
• redo segmentation and handtracking
• prototype handtracking
• automated browser tests
• support for dynamic backend switching
• initial automated browser tests
• enhanced automated test coverage
• more automated tests
• added configuration validation
• prevent validation failed on some model combinations
• webgl exception handling

2.2.2 2021/09/17 [email protected]

• experimental webgl status monitoring
• major release

2.2.1 2021/09/16 [email protected]

• add vr model demo
• all tests passing
• redefine draw helpers interface
• add simple webcam and webrtc demo
• added visual results browser to demo
• reorganize tfjs bundle
• experimental custom tfjs bundle - disabled
• add platform and backend capabilities detection
• enhanced automated tests
• enable canvas patching for nodejs
• full ts strict typechecks
• fix multiple memory leaks
• modularize human class and add model validation
• add dynamic kernel op detection
• added human.env diagnostic class
• minor typos
• release candidate
• parametrize face config
• mark all config items as optional
• redefine config and result interfaces
• fix usge of string enums
• start using partial definitions
• implement event emitters
• fix iife loader
• simplify dependencies
• change build process
• add benchmark info
• simplify canvas handling in nodejs
• full rebuild

2.1.5 2021/08/31 [email protected]

• added demo node-canvas
• dynamically generate default wasm path
• implement finger poses in hand detection and gestures
• implemented movenet-multipose model

2.1.4 2021/08/19 [email protected]

• add static type definitions to main class
• fix interpolation overflow
• rebuild full
• improve face box caching
• strict type checks
• add webgu checks
• experimental webgpu support
• add experimental webgu demo
• add backend initialization checks
• complete async work
• list detect cameras
• switch to async data reads

2.1.3 2021/08/12 [email protected]

• fix centernet & update blazeface
• minor update
• replace movenet with lightning-v4
• enable webgl uniform support for faster warmup

2.1.2 2021/07/29 [email protected]

• fix unregistered ops in tfjs
• fix typo
• rebuild new release

2.1.1 2021/07/29 [email protected]

• add note on manually disping tensor
• modularize model loading

2.0.3 2021/06/18 [email protected]

• fix demo paths
• added multithreaded demo

2.0.2 2021/06/14 [email protected]

• reorganize demos
• fix centernet box width & height
• add body segmentation sample
• add release notes
• release 2.0

2.0.1 2021/06/08 [email protected]

• add video drag&drop capability
• modularize build platform
• custom build tfjs from sources
• modularize build platform
• enable body segmentation and background replacement in demo
• minor git corruption
• unified build
• enable body segmentation and background replacement
• work on body segmentation
• added experimental body segmentation module
• add meet and selfie models
• add live hints to demo
• switch worker from module to iife importscripts
• release candidate
• added samples to git
• implemented drag & drop for image processing
• release candidate
• breaking changes to results.face output properties
• breaking changes to results.object output properties
• breaking changes to results.hand output properties
• breaking changes to results.body output properties
• implemented human.next global interpolation method
• finished draw buffering and smoothing and enabled by default
• implemented service worker
• release candidate
• added usage restrictions
• quantize handdetect model
• added experimental movenet-lightning and removed blazepose from default dist
• added experimental face.rotation.gaze
• fix and optimize for mobile platform
• lock typescript to 4.2 due to typedoc incompatibility with 4.3

1.9.4 2021/05/27 [email protected]

• fix demo facecompare
• webhint and lighthouse optimizations
• add camera startup diag messages
• implemented unified result.persons that combines face, body and hands for each person
• added experimental results interpolation for smooth draw operations

1.9.3 2021/05/23 [email protected]

• use green weighted for input diff calculation
• implement experimental drawoptions.bufferedoutput and bufferedfactor
• use explicit tensor interface
• add tfjs types and remove all instances of any
• enhance strong typing
• rebuild all for release

1.9.2 2021/05/22 [email protected]

• add id and boxraw on missing objects
• restructure results strong typing

1.9.1 2021/05/21 [email protected]

• caching improvements
• add experimental mb3-centernet object detection
• individual model skipframes values still max high threshold for caching
• config.videooptimized has been removed and config.cachesensitivity has been added instead
• caching determination is now dynamic based on detection of input change and not based on input types
• human 1.9.0 beta with breaking changes regarding caching

1.8.5 2021/05/18 [email protected]

• add node-video sample
• add node-webcam demo
• fix node build and update model signatures

1.8.4 2021/05/11 [email protected]

1.8.3 2021/05/05 [email protected]

• switch posenet weights

1.8.2 2021/05/04 [email protected]

• release 1.8 with major changes and tfjs 3.6.0

1.8.1 2021/04/30 [email protected]

• blazeface optimizations
• add hand labels in draw
• cleanup demo workflow
• convert blazeface to module
• version 1.8 release candidate
• build nodejs deliverables in non-minified form
• stop building sourcemaps for nodejs deliverables
• remove deallocate, profile, scoped
• replaced maxfaces, maxdetections, maxhands, maxresults with maxdetected
• replaced nmsradius with built-in default
• unified minconfidence and scorethresdold as minconfidence
• add exception handlers to all demos
• remove blazeface-front and add unhandledrejection handler
• major update for 1.8 release candidate
• enable webworker detection

1.7.1 2021/04/25 [email protected]

• remove obsolete binary models
• enable cross origin isolation
• rewrite posenet decoder
• remove efficientpose
• major version rebuild

1.6.1 2021/04/22 [email protected]

• add npmrc
• added filter.flip feature
• added demo load image from http
• mobile demo optimization and iris gestures
• full rebuild
• new look
• added benchmarks
• added node-multiprocess demo
• fix image orientation
• flat app style
• add full nodejs test coverage

1.5.2 2021/04/14 [email protected]

• experimental node-wasm support

1.5.1 2021/04/13 [email protected]

• fix for safari imagebitmap
• refactored human.config and human.draw

1.4.3 2021/04/12 [email protected]

• implement webrtc

1.4.2 2021/04/12 [email protected]

• added support for multiple instances of human
• fix typedoc
• exception handling

1.4.1 2021/04/09 [email protected]

• add modelbasepath option

1.3.5 2021/04/06 [email protected]

• add dynamic viewport and fix web worker
• add cdn links

1.3.4 2021/04/04 [email protected]

• implement webhint

1.3.3 2021/04/03 [email protected]

• fix linting and tests

1.3.2 2021/04/02 [email protected]

• input type validation
• normalize all scores

1.3.1 2021/03/30 [email protected]

• added face3d demo
• initial work on face3d three.js demo
• enable buffering
• new icons
• new serve module and demo structure
• move gl flags to correct location
• minor rotation calculation fix
• remove debug output
• new face rotation calculations
• cleanup
• rotationmatrixtoeulerangle, and fixes
• experimental: add efficientpose
• implement nanodet
• face rotation matrix
• start working on efficientpose

1.2.5 2021/03/25 [email protected]

• fix broken exports
• added face matching example to docs
• improve fact matching

1.2.4 2021/03/23 [email protected]

1.2.3 2021/03/21 [email protected]

1.2.2 2021/03/21 [email protected]

• precise face rotation

1.2.1 2021/03/21 [email protected]

• new module: face description

1.1.11 2021/03/21 [email protected]

• refactor face classes

1.1.10 2021/03/18 [email protected]

• cleanup
• redefine tensor
• enforce types
• regen type declarations
• switch to single jumbo dts
• type definitions

1.1.9 2021/03/17 [email protected]

• fix box clamping and raw output
• hierarchical readme notes

1.1.8 2021/03/17 [email protected]

• add experimental nanodet object detection
• full models signature

1.1.7 2021/03/16 [email protected]

• fix for seedrandom
• custom typedoc

1.1.6 2021/03/15 [email protected]

• implement human.match and embedding demo

1.1.5 2021/03/15 [email protected]

• full rebuild

1.1.4 2021/03/14 [email protected]

• fix broken build

1.1.3 2021/03/14 [email protected]

• added api specs
• add typedocs and types
• strong typings

1.1.2 2021/03/12 [email protected]

• distance based on minkowski space and limited euclidean space
• guard against invalid input images

1.1.1 2021/03/12 [email protected]

• switched face embedding to mobileface

1.0.4 2021/03/11 [email protected]

• add face return tensor
• add test for face descriptors
• wip on embedding
• simplify face box coordinate calculations
• annotated models and removed gender-ssrnet
• autodetect inputsizes

1.0.3 2021/03/10 [email protected]

• strong typing for public classes and hide private classes
• enhanced age, gender, emotion detection
• full rebuild

1.0.2 2021/03/09 [email protected]

• remove blazeface-front, blazepose-upper, faceboxes
• remove blazeface-front and faceboxes

1.0.1 2021/03/09 [email protected]

• fix for face detector when mesh is disabled
• optimize for npm
• 0.40.9
• fix performance issue when running with low confidence
• 0.40.8
• 0.40.7
• implemented 3d face angle calculations
• 0.40.6
• add curve draw output
• 0.40.5
• fix human.draw
• 0.40.4
• fix demo
• 0.40.3
• 0.40.2
• added blazepose-upper
• 0.40.1
• implement blazepose and update demos
• add todo list
• 0.30.6
• fine tuning age and face models
• 0.30.5
• add debug logging flag
• 0.30.4
• added skipinitial flag
• 0.30.3
• typo
• 0.30.2
• rebuild
• fix typo
• 0.30.1
• 0.20.11
• 0.20.10
• 0.20.9
• 0.20.8
• 0.20.7
• build fix
• 0.20.6
• embedding fix
• 0.20.5
• fix imagefx and add dev builds
• 0.20.4
• 0.20.3
• rebuild
• 0.20.2
• merge branch 'main' of https://github.com/vladmandic/human into main
• create codeql-analysis.yml
• create security.md
• add templates
• 0.20.1
• menu fixes
• convert to typescript
• 0.11.5
• added faceboxes alternative model
• 0.11.4
• 0.11.3
• 0.11.2
• added warmup for nodejs
• 0.11.1
• 0.10.2
• 0.10.1

0.9.26 2021/01/18 [email protected]

• fix face detection when mesh is disabled
• version bump

0.9.25 2021/01/13 [email protected]

• added humangl custom backend
• rebuild
• code cleanup and enable minification
• fix safari incopatibility

0.9.24 2021/01/12 [email protected]

• work on blazepose
• full rebuild

0.9.23 2021/01/11 [email protected]

• added iris gesture
• fix emotion labels
• full rebuild

0.9.22 2021/01/05 [email protected]

• remove iris coords if iris is disabled
• web worker fix

0.9.21 2021/01/03 [email protected]

0.9.20 2021/01/03 [email protected]

• stricter linting, fix face annotations

0.9.19 2020/12/23 [email protected]

• added rawbox and rawmesh
• variable name changes, setting .rawcoords only if necessary
• option to return raw data (mesh, box) for facemesh / "preserve aspect ratio" fix from facemesh upstream

0.9.18 2020/12/16 [email protected]

• add z axis scaling
• major work on body module
• republish due to tfjs 2.8.0 issues

0.9.17 2020/12/15 [email protected]

• added custom webgl backend

0.9.16 2020/12/12 [email protected]

• change default ports

0.9.15 2020/12/11 [email protected]

• improved caching and warmup
• rebuild

0.9.14 2020/12/10 [email protected]

• conditional hand rotation
• staggered skipframes

0.9.13 2020/12/08 [email protected]

• implemented face and hand boundary checks
• embedded sample for warmup
• switch to central logger

0.9.12 2020/11/26 [email protected]

• minor compatibility fixes

0.9.11 2020/11/23 [email protected]

• implement multi-person gestures
• modularize pipeline models

0.9.10 2020/11/21 [email protected]

• changed build for optimized node & browser

0.9.9 2020/11/21 [email protected]

• new screenshots
• camera exception handling

0.9.8 2020/11/19 [email protected]

• force f16 textures
• bugfix embedding check

0.9.7 2020/11/19 [email protected]

• ui redesign

0.9.6 2020/11/18 [email protected]

• optimize camera resize on mobile
• completed tfjs wrapper

0.9.5 2020/11/17 [email protected]

• fix serious performance bug around skipframes
• swtich to custom tfjs bundle

0.9.4 2020/11/17 [email protected]

• swtich to tfjs source import

0.9.3 2020/11/16 [email protected]

• switched to minified build
• web worker fixes
• full rebuild

0.9.2 2020/11/14 [email protected]

• fix camera restart on resize

0.9.1 2020/11/13 [email protected]

• version bump
• full rebuild
• implemented face embedding
• added internal benchmark tool

0.8.8 2020/11/12 [email protected]

• reduced bundle size
• implemented buffered processing
• fix for conditional model loading

0.8.7 2020/11/11 [email protected]

• added performance notes
• added notes on models
• fix bug in async ops and change imports
• fix wiki links

0.8.6 2020/11/09 [email protected]

• add wasm bundle

0.8.5 2020/11/09 [email protected]

• reimplemented blazeface processing

0.8.4 2020/11/09 [email protected]

• added additional gestures
• implemented blink detection
• fix wasm module

0.8.3 2020/11/08 [email protected]

• refresh
• optimizations

0.8.2 2020/11/08 [email protected]

• fix typos
• commit

0.8.1 2020/11/07 [email protected]

• fix hand detection performance
• optimized model loader
• merge branch 'main' of https://github.com/vladmandic/human into main
• created wiki
• optimize font resizing
• fix nms sync call

0.7.6 2020/11/06 [email protected]

• fixed memory leaks and updated docs
• model tuning
• cache invalidation improvements
• full async operations

0.7.5 2020/11/05 [email protected]

• implemented dev-server

0.7.4 2020/11/05 [email protected]

• fix canvas size on different orientation
• switched from es2020 to es2018 build target

0.7.3 2020/11/05 [email protected]

• optimized camera and mobile layout
• fixed worker and filter compatibility

0.7.2 2020/11/04 [email protected]

• major work on handpose model

0.7.1 2020/11/04 [email protected]

• changed demo build process

0.6.7 2020/11/04 [email protected]

• implemented simple gesture recognition

0.6.6 2020/11/04 [email protected]

• remove debug code

0.6.5 2020/11/04 [email protected]

• redo hand detection

0.6.4 2020/11/03 [email protected]

• added manifest

0.6.3 2020/11/03 [email protected]

• enhanced processing resolution
• fix pause restart
• complete model refactoring
• fixed typo

0.6.2 2020/11/02 [email protected]

• optimized demo
• package update

0.6.1 2020/11/02 [email protected]

• major performance improvements for all models
• revert "optimized canvas handling"
• optimized canvas handling
• minor optimization to imagefx
• fix demo image sample
• added tfjs-vis to distribution

0.5.5 2020/11/01 [email protected]

• changed defaults

0.5.4 2020/11/01 [email protected]

• implemented memory profiler

0.5.3 2020/10/30 [email protected]

• improved debug logging

0.5.2 2020/10/30 [email protected]

• added wasm and webgpu backends

0.5.1 2020/10/30 [email protected]

• improve demo line continous draws

0.4.10 2020/10/30 [email protected]

• fix for seedrandom

0.4.9 2020/10/29 [email protected]

0.4.8 2020/10/28 [email protected]

• revert "updated menu handler"

0.4.7 2020/10/27 [email protected]

0.4.6 2020/10/27 [email protected]

• fix firefox compatibility bug

0.4.5 2020/10/27 [email protected]

0.4.4 2020/10/27 [email protected]

• implelented input resizing

0.4.3 2020/10/22 [email protected]

0.4.2 2020/10/20 [email protected]

• log initialization

0.4.1 2020/10/19 [email protected]

• breaking change: convert to object class
• compatibility notes

0.3.9 2020/10/18 [email protected]

• implemented image filters
• pure tensor pipeline without image converts
• autodetect skipframes

0.3.8 2020/10/17 [email protected]

• new menu layout

0.3.7 2020/10/17 [email protected]

• added diagnostics output
• parallelized agegender operations

0.3.6 2020/10/17 [email protected]

• fixed webcam initialization
• fixed memory leaks and added scoped runs
• modularized draw
• added state handling
• refactored package file layout

0.3.5 2020/10/16 [email protected]

• added auto-generated changelog

0.3.4 2020/10/16 [email protected]

• added camera selection
• optimized blazeface anchors
• added error handling

0.3.3 2020/10/15 [email protected]

• added blazeface back and front models

0.3.2 2020/10/15 [email protected]

• reduced web worker latency
• added debugging and versioning
• optimized demos and added scoped runs
• added multi backend support

0.3.1 2020/10/14 [email protected]

0.2.10 2020/10/14 [email protected]

• added emotion backend
• module parametrization and performance monitoring
• implemented multi-hand support
• fixed documentation typos

0.2.9 2020/10/13 [email protected]

• added node build and demo

0.2.8 2020/10/13 [email protected]

0.2.7 2020/10/13 [email protected]

• new examples

0.2.6 2020/10/13 [email protected]

• enable all models by default

0.2.5 2020/10/12 [email protected]

• fixed memory leak

0.2.4 2020/10/12 [email protected]

0.2.3 2020/10/12 [email protected]

0.2.2 2020/10/12 [email protected]

0.2.1 2020/10/12 [email protected]

• added sample image
• initial public commit
• initial commit