ffmpeg-api

A mod that lets developers easily interact with ffmpeg to record raw videos, and mix video and audio files.

Usage

Record videos

Normal API

#include <eclipse.ffmpeg-api/include/recorder.hpp>

void video() {
    ffmpeg::Recorder recorder;

    ffmpeg::RenderSettings settings;

    //ffmpeg-api will automatically handle conversion between the input pixel
    //format and the codec's pixel format
    settings.m_pixelFormat = PixelFormat::RGB0;
    settings.m_codec = "h264_nvenc"; //fetch codecs using recorder.getAvailableCodecs()
    settings.m_bitrate = 30000000;
    settings.m_width = 1920;
    settings.m_height = 1080;
    settings.m_fps = 60;
    settings.m_outputFile = "output_video.mp4";

    //insert your raw data here
    std::vector<uint8_t> frame;

    recorder.init(settings);

    for(int i = 0; i < 60; i++)
        recorder.writeFrame(frame);

    recorder.stop();
}

Event-based API

#include <events.hpp>

void video() {
    ffmpeg::events::Recorder recorder;

    ffmpeg::RenderSettings settings;

    //ffmpeg-api will automatically handle conversion between the input pixel
    //format and the codec's pixel format
    settings.m_pixelFormat = PixelFormat::RGB0;
    settings.m_codec = "h264_nvenc"; //fetch codecs using recorder.getAvailableCodecs()
    settings.m_bitrate = 30000000;
    settings.m_width = 1920;
    settings.m_height = 1080;
    settings.m_fps = 60;
    settings.m_outputFile = "output_video.mp4";

    //insert your raw data here
    std::vector<uint8_t> frame;

    recorder.init(settings);

    for(int i = 0; i < 60; i++)
        recorder.writeFrame(frame);

    recorder.stop();
}

Mix audio

Normal API

#include <eclipse.ffmpeg-api/include/audio_mixer.hpp>

void audioFile() {
    ffmpeg::AudioMixer::mixVideoAudio("video.mp4", "audio.mp3", "output_mp3.mp4");
    ffmpeg::AudioMixer::mixVideoAudio("video.mp4", "audio.wav", "output_wav.mp4");
}

void audioRaw() {
    //insert your raw data here
    std::vector<float> raw;
    ffmpeg::AudioMixer::mixVideoRaw("video.mp4", raw, "output_raw.mp4");
}

Event-based API

#include <events.hpp>

void audioFile() {
    ffmpeg::events::AudioMixer::mixVideoAudio("video.mp4", "audio.mp3", "output_mp3.mp4");
    ffmpeg::events::AudioMixer::mixVideoAudio("video.mp4", "audio.wav", "output_wav.mp4");
}

void audioRaw() {
    //insert your raw data here
    std::vector<float> raw;
    ffmpeg::events::AudioMixer::mixVideoRaw("video.mp4", raw, "output_raw.mp4");
}

Build instructions

Windows

To get the needed libraries on Windows, you can use vcpkg:

vcpkg install ffmpeg[core,avcodec,avformat,avfilter,swscale,swresample,amf,x264,x265,nvcodec,openh264,aom,vpx]:x64-windows-static-md --recurse

the other libraries are part of the Windows SDK

Android

To get the needed libraries on Android, you can use this script, make sure you have pkg-config installed before running it. Read the README in the repository for further instructions.

git clone https://github.com/EclipseMenu/ffmpeg-android-maker/
cd ffmpeg-android-maker
./ffmpeg-android-maker.sh --enable-libaom --enable-libvpx --enable-libx264 --enable-libx265 --android-api-level=24

You can either run it natively on Linux or using WSL on Windows.

When building for android32 you need to set android version 24, you can do so by adding this arg to your geode build command

geode build --platform android32 --config Release -- -DANDROID_PLATFORM=24

MacOS

To get the needed libraries on MacOS, you must have pkg-config installed, have BZIP2, and build x264 from source.

brew install pkgconfig
brew install bzip2

git clone https://code.videolan.org/videolan/x264.git
cd x264
./configure --enable-static
make

git clone https://git.ffmpeg.org/ffmpeg.git ffmpeg
brew install automake fdk-aac git lame libass libtool libvorbis libvpx opus sdl shtool texi2html theora wget x264 x265 xvid nasm
mkdir output
./configure --prefix=$PWD/output --enable-static --enable-libx264 --enable-gpl
make