synaesthesia

synaesthesia — Creates video visualizations of audio input, using stereo and pitch information

Synopsis

                    GstSynaesthesia;

Description

Synaesthesia is an audio visualisation element. It creates glitter and pulsating fog based on the incomming audio signal.

Example launch line

1
2
gst-launch -v audiotestsrc ! audioconvert ! synaesthesia ! ximagesink
gst-launch -v audiotestsrc ! audioconvert ! synaesthesia ! ffmpegcolorspace ! xvimagesink

Details

GstSynaesthesia

typedef struct {
  GstElement element;

  /* pads */
  GstPad *sinkpad, *srcpad;
  GstAdapter *adapter;

  guint64 next_ts;              /* the timestamp of the next frame */
  guint64 frame_duration;
  guint bps;                    /* bytes per sample        */
  guint spf;                    /* samples per video frame */

  gint16 datain[2][FFT_BUFFER_SIZE];

  /* video state */
  gint fps_n, fps_d;
  gint width;
  gint height;
  gint channels;

  /* Audio state */
  gint sample_rate;
  gint rate;

  /* Synaesthesia instance */
  syn_instance *si;
} GstSynaesthesia;

See Also

goom