Recherche avancée

Sur d’autres sites (9535)

• Minimal Understanding of VP8′s Forward Transform

  16 novembre 2010, par Multimedia Mike — VP8

  Regarding my toy VP8 encoder, Pengvado mentioned in the comments of my last post, “x264 looks perfect using only i16x16 DC mode. You must be doing something wrong in computing residual or fdct or quantization.” This makes a lot of sense. The encoder generates a series of elements which describe how to reconstruct the original image. Intra block reconstruction takes into consideration the following elements :

  
  
  

  I have already verified that both my encoder and FFmpeg’s VP8 decoder agree precisely on how to reconstruct blocks based on the predictors, coefficients, and quantizers. Thus, if the decoded image still looks crazy, the elements the encoder is generating to describe the image must be wrong.

  So I started studying the forward DCT, which I had cribbed wholesale from the original libvpx 0.9.0 source code. It should be noted that the formal VP8 spec only defines the inverse transform process, not the forward process. I was using a version designated as the “short” version, vs. the “fast” version. Then I looked at the 0.9.5 FDCT. Then I got the idea of comparing the results of each.

  input:   92 91 89 86 91 90 88 86 89 89 89 88 89 87 88 93

  • libvpx 0.9.0 “short” :

    forward : -314 5 1 5 4 5 -2 0 0 1 -1 -1 1 11 -3 -4
    inverse : 92 91 89 86 89 86 91 90 91 90 88 86 88 86 89 89
    

  • libvpx 0.9.0 “fast” :

    forward : -314 4 0 5 4 4 -2 0 0 1 0 -1 1 11 -2 -5
    inverse : 91 91 89 86 88 86 91 90 91 90 88 86 88 86 89 89
    

  • libvpx 0.9.5 “short” :

    forward : -312 7 1 0 1 12 -5 2 2 -3 3 -1 1 0 -2 1
    inverse : 92 91 89 86 91 90 88 86 89 89 89 88 89 87 88 93
    

  I was surprised when I noticed that input[] != idct(fdct(input[])) in some of the above cases. Then I remembered that the aforementioned property isn’t what is meant by a “bit-exact” transform– only that all implementations of the inverse transform are supposed to produce bit-exact output for a given vector of input coefficients.

  Anyway, I tried applying each of these forward transforms. I got slightly differing results, with the latest one I tried (the fdct from libvpx 0.9.5) producing the best results (to my eye). At least the trees look better in the Big Buck Bunny logo image :

  
  
  The dense trees of the Big Buck Bunny logo using one of the libvpx 0.9.0 forward transforms
  
  
  The same segment of the image using the libvpx 0.9.5 forward transform
  

  Then again, it could be that the different numbers generated by the newer forward transform triggered different prediction modes to be chosen. Overall, adapting the newer FDCT did not dramatically improve the encoding quality.

  Working on the intra 4×4 mode encoding is generating some rather more accurate blocks than my intra 16×16 encoder. Pengvado indicated that x264 generates perfectly legible results when forcing the encoder to only use intra 16×16 mode. To be honest, I’m having trouble understanding how that can possibly occur thanks to the Walsh-Hadamard transform (WHT). I think that’s where a lot of the error is creeping in with my intra 16×16 encoder. Then again, FFmpeg implements an inverse WHT function that bears ‘vp8′ in its name. This implies that it’s custom to the algorithm and not exactly shared with H.264.

• how do i modify this ffmpeg build script for minimal binary size output

  13 janvier 2015, par Brian

  I’m trying to build the ffmpeg binaries for android on 3 chipsets. The output file size is too large to include in the project around 15mb.

  https://github.com/falnatsheh/ffmpeg-android is the github project repo

  the .sh build script for ffmpeg is like this

  #!/bin/bash
  
  
  
  . abi_settings.sh $1 $2 $3
  
  
  
  pushd ffmpeg
  
  
  
  case $1 in
  
    armeabi-v7a | armeabi-v7a-neon)
  
      CPU='cortex-a8'
  
    ;;
  
    x86)
  
      CPU='i686'
  
    ;;
  
  esac
  
  
  
  make clean
  
  
  
  ./configure \
  
  --target-os="$TARGET_OS" \
  
  --cross-prefix="$CROSS_PREFIX" \
  
  --arch="$NDK_ABI" \
  
  --cpu="$CPU" \
  
  --enable-runtime-cpudetect \
  
  --sysroot="$NDK_SYSROOT" \
  
  --enable-pic \
  
  --enable-libx264 \
  
  --enable-pthreads \
  
  --disable-debug \
  
  --disable-ffserver \
  
  --enable-version3 \
  
  --enable-hardcoded-tables \
  
  --disable-ffplay \
  
  --disable-ffprobe \
  
  --enable-gpl \
  
  --enable-yasm \
  
  --disable-doc \
  
  --disable-shared \
  
  --enable-static \
  
  --pkg-config="${2}/ffmpeg-pkg-config" \
  
  --prefix="${2}/build/${1}" \
  
  --extra-cflags="-I${TOOLCHAIN_PREFIX}/include $CFLAGS" \
  
  --extra-ldflags="-L${TOOLCHAIN_PREFIX}/lib $LDFLAGS" \
  
  --extra-libs="-lm" \
  
  --extra-cxxflags="$CXX_FLAGS" || exit 1
  
  
  
  make -j${NUMBER_OF_CORES} && make install || exit 1
  
  
  
  popd

  I tried adding —disable-everything as the first line in configure but then the compiler complains that I didnt set a target-os even though its the next line

  In the app I only use ffmpeg to take input mp4 videos and transpose and rotate them
  here are the two commands

  -y -i %s -vf transpose=%d -tune film -metadata:s:v rotate=0 -c:v libx264 -preset ultrafast -crf 27 -c:a copy -bsf:a aac_adtstoasc %s

  where %s is a file path

  and then concat files

  -y -i concat:%s -preset ultrafast -crf 27 -c:v copy -c:a copy -bsf:a aac_adtstoasc %s

  If someone can help me with the build script that would be awesome

• ffmpeg is making my audio and video frozen and I don't know why

  17 avril 2024, par Sdpro

  I'm using bunjs runtime to execute ffmpeg as terminal code but I don't know if my code is typescript code is wrong or ffmpeg is wrong
and I'm using json file to get the clips correctly

  


      let videos = 0;
    let stepsTrim = "";
    let concatInputs = "";

    for (let i = 0; i < 40; i++) {
        if (unwantedWords[i].keepORdelete === true) {
            stepsTrim += `[0:v]trim=0:${
                unwantedWords[i].start
            },setpts=PTS[v${i}];[0:a]atrim=0:${
                unwantedWords[i].start
            },asetpts=PTS-STARTPTS[a${i}];[0:v]trim=${unwantedWords[i].start}:${
                unwantedWords[i].end
            },setpts=PTS[v${unwantedWords.length + i + 1}];[0:a]atrim=${
                unwantedWords[i].start
            }:${unwantedWords[i].end},asetpts=PTS-STARTPTS[a${
                unwantedWords.length + i + 1
            }];`;

            concatInputs += `[v${i}][a${i}][v${unwantedWords.length + i + 1}][a${
                unwantedWords.length + i + 1
            }]`;
            videos += 2; 
        }
    }

    stepsTrim = stepsTrim.slice(0, -1);

    await $`ffmpeg -hide_banner -i ${videoRequirements.output} -filter_complex "${stepsTrim},${concatInputs} concat=n=${videos}:v=1:a=1[outv][outa]" -map "[outv]" -map "[outa]" -c:v libopenh264 -preset slow -c:a mp3 -vsync 1 -y ${removedUnwantedWords}/fastAf.mp4`;


  


  at the end after everything was done :

  


  warning
[vost#0:0/libopenh264 @ 0x558f80ea1dc0] More than 1000 frames duplicated.9kbits/s dup=110 drop=1 speed=0.831x    
[out_0_0 @ 0x558f8100a880] 100 buffers queued in out_0_0, something may be wrong. dup=1064 drop=1 speed=1.43x    
[out_0_1 @ 0x558f8100af80] 100 buffers queued in out_0_1, something may be wrong.
[out_0_1 @ 0x558f8100af80] 1000 buffers queued in out_0_1, something may be wrong.
I can't figure out why ffmpeg is sometimes making the audio + video work and sometimes not
[enter image description here](https://i.stack.imgur.com/PicaA.png)


  


  [
  {
    "word": "Hello",
    "id": 0,
    "keepORdelete": false,
    "start": 0,
    "end": 9.06
  },
  {
    "word": "guys,",
    "id": 1,
    "keepORdelete": false,
    "start": 9.06,
    "end": 10.2
  },
  {
    "word": "there",
    "id": 2,
    "keepORdelete": false,
    "start": 11.76,
    "end": 12.06
  },
...


  


  I have tried commands from many types of ffmpeg commands changing the code and I can't seem to get the audio and video right