Skip to content

Chroma key a video/image/canvas element in real time using the GPU

License

Notifications You must be signed in to change notification settings

bhj/gl-chromakey

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

84 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

gl-chromakey

Chroma key a video/image/canvas element in real time using the GPU. Based on work by Brian Chirls.

  • Multiple key colors with adjustable tolerance
  • Automatic background color detection and keying
  • Designed for requestAnimationFrame (when used with video)
  • Uses WebGL 2
  • No dependencies

Installation

$ npm i gl-chromakey

API

new GLChroma(source, target)

  • source: Source video, image or canvas element to key
  • target: Target canvas element on which to paint keyed image(s)
const GLChroma = require('gl-chromakey')
const video = document.getElementById('my-video')
const canvas = document.getElementById('my-canvas')

// set source video and target canvas elements
const chroma = new GLChroma(video, canvas)

.hasWebGL2()

Returns true if browser supports WebGL 2, else false.

.key([key] [, ...keyN])

Sets one or more key colors in RGB, replacing any prior settings. Calling without parameters clears all key colors.

  • key: any of the following:
    • the string 'auto'
    • array of color values like [r, g, b] (keys a single color with default tolerance)
    • array of objects with properties:
      • color (required): the string 'auto' or an array of color values like [r, g, b]
      • tolerance: float ranged 0-1; allowed distance from color (default=0.3)
      • amount: float ranged 0-1; strength of alpha effect (default=1.0)

The auto key color mode works by downsampling the source image, grabbing each corner pixel, and keying on the two pixels with the most similar color. It works best on video or images with simplistic backgrounds, and if the algorithm gets it wrong, can cause flickering in some cases.

Examples:

// detect background color (per-frame, works best with solid-ish backgrounds)
chroma.key('auto')
chroma.key({ color: 'auto', tolerance: 0.3 }) // equivalent

// a very greenscreen
chroma.key([0, 255, 0])
chroma.key({ color: [0, 255, 0], tolerance: 0.3 }) // equivalent

.paint()

Re-paints current frame to canvas.

.render()

Updates frame from source element and paints to target canvas. The following excerpt shows its use with a video element and a requestAnimationFrame loop to update the video frames:

let frameId

// methods for render loop
startChroma = () => {
  frameId = requestAnimationFrame(startChroma)
  chroma.render()
}
stopChroma = () => cancelAnimationFrame(frameId)

// link to <video> element
video.addEventListener('play', startChroma)
video.addEventListener('pause', stopChroma)
video.addEventListener('ended', stopChroma)

.source(el)

Sets a new source video, image or canvas element to key.

  • el: the new video/image/canvas element

.target(canvas)

Sets a new target canvas on which to paint keyed image(s). The context webgl2 will be used.

License

ISC

About

Chroma key a video/image/canvas element in real time using the GPU

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Contributors 3

  •  
  •  
  •