Recherche avancée

Sur d’autres sites (8398)

• FFMPeg generated video : Audio has 'glitches' when uploaded to YouTube

  7 octobre 2023, par CularBytes

  I've generated a voice from Azure AI Speech at 48KHz and 96K Bit Rate, generated a video of some stock footages and I'm trying to combine all of that with a background music.
The voice-over is generated per setence, so that I know how long each setence is and to include relevant video footage.

  


  I'm using FFMpeg through the FFMpegCore nuget package.

  


  The problem

  


  After the video is complete with background music, I play it on my computer and it's perfect (no audio glitches, music keeps playing). But when uploaded to youtube it has 'breaks' in the music inbetween sentences (basically everytime a new voice-fragment is starting).

  


  Example : https://www.youtube.com/watch?v=ieNvQ2TNq44

  


  The code

  


  All of the footage is combined with mostly FFMpeg.Join(string output, string[] videos). These video files also contain the voice-overs (per sentance).

  


  After that I try to add the music like this :

  


     string outputTimelineWithMusicPath = _workingDir + $@"\{videoTitle}_withmusic.mp4";
    FFMpegArguments
        .FromFileInput(inputVideoPath)
        .AddFileInput(musicPath)
        .OutputToFile(outputPath, true, options => options
            .CopyChannel()
            .WithAudioCodec(AudioCodec.Aac)
            .WithAudioBitrate(AudioQuality.Good)
            .UsingShortest(true)
            .WithCustomArgument("-filter_complex \"[0:a]aformat=fltp:44100:stereo,apad[0a];[1]aformat=fltp:44100:stereo,volume=0.05[1a];[0a][1a]amerge[a]\" -map 0:v -map \"[a]\" -ac 2"))
        .ProcessSynchronously();


  


  I've tried to mess around with the CustomArgument, but so far no success.

  


  For example, I thought removing apad from the argument so no 'blank spots' are added, should perhaps fix the issue. Also tried to use amix instead of amerge.

  


  Last try

  


  I've tried to first make sure both files had the same sample rate, in the hope to fix the issue. So far, no success

  


      string outputVideoVoicePath = _workingDir + $@"\{title}_voiceonly_formatting.mp4";
    string musicReplacePath = _workingDir + $@"\{title}_music_formatted.aac";
    FFMpegArguments
    .FromFileInput(inputVideoPath)
    .OutputToFile(outputVideoVoicePath, true, options => options
        .WithAudioCodec(AudioCodec.Aac)
        .WithAudioBitrate(128)
        .WithAudioSamplingRate(44100)
    )
    .ProcessSynchronously();
    
    FFMpegArguments
        .FromFileInput(music.FilePath)
        .OutputToFile(musicReplacePath, true, options => options
            .WithAudioCodec(AudioCodec.Aac)
            .WithAudioBitrate(256) //also tried 96 (which is original format)
            .WithAudioSamplingRate(44100)
        )
        .ProcessSynchronously();
    
    
    Console.WriteLine("Add music...");
    var videoTitle = Regex.Replace(title, "[^a-zA-Z]+", "");
    string outputTimelineWithMusicPath = _workingDir + $@"\{videoTitle}_withmusic.mp4";
    FFMpegArguments
        .FromFileInput(outputVideoVoicePath)
        .AddFileInput(musicReplacePath)
        .OutputToFile(outputTimelineWithMusicPath, true, options => options
            .CopyChannel()
            .WithAudioCodec(AudioCodec.Aac)
            .WithAudioBitrate(AudioQuality.Good)
            .UsingShortest(true)
            .WithCustomArgument("-filter_complex \"[0:a]aformat=fltp:44100:stereo[0a];[1]aformat=fltp:44100:stereo,volume=0.05[1a];[0a][1a]amix=inputs=2[a]\" -map 0:v -map \"[a]\" -ac 2"))
        .ProcessSynchronously();
    return outputTimelineWithMusicPath;


  


  I'm not much of an expert when it comes to audio/video codecs. I do scale each stock video to 24fps, 1920x1080 and the music has a original bitrate of 256Kbps / 44100 sample rate (so I probably don't even have to convert the audio file).

  


• Combine .dash video and audio segments to .mp4

  11 décembre 2019, par Mike Stevens

  I was able to download some dash video segments (youtube-dl was apparently blocked from downloading the .mpd and just downloading, concatenating as normal) and was hoping to combine/concatenate them so I could watch in VLC, perhaps using ffmpeg. I was able to download the relevant .mpd and .ismc files, so I have all of the DASH video and audio segments, as well as the .mpd and .ismc downloaded and in one folder.

  The video files are labelled as such

  video=869000.dash
  
  video=869000-0.dash
  
  video=869000-600.dash
  
  video=869000-1200.dash

  and the audio in a similar fashion

  audio=96000.dash
  
  audio=96000-0.dash
  
  audio=96000-96225.dash

  Would anyone know of a way to combine all of these into one watchable video file ? AdobeHDS used to work great for combining fragments, and youtube-dl cleary has some sort of method to do it, but neither works with this particular .mpd. I don’t believe concatenate in ffmpeg will work, when I try to do that, it initializes the first .dash file (audio or video), but stops there.

  When I try to put the .mpd file through ffmpeg, it returns "Failed to open an initialization section in playlist 0". I would’ve assumed this initialization was the video=869000.dash file though (which is the one segment file that ffmpeg does recognize) ?

• ffmpeg : Convert a legally purchased video on Google

  24 avril 2020, par Heycava

  I've bought a video on the Google Play Store. I need to have it on my computer in order to edit it for a video montage. But Google says "Important : You cannot download movies and TV shows onto a PC, Mac, and other laptops or computers."

  



  The video has a YouTube link. As I paid for it, I can watch it. I've managed to get the video part and the audio thanks to some web tools.
The video is a .webm file and the audio a .m4a file.

  



  I can hear the audio with VLC but I can't watch the video. Even if VLC displays "21:42" for the timecode.

  



  Here are informations for the webm file (from MediaInfo) :

  



  General
Complete name                            : XXX\videoplayback.webm
Format                                   : WebM
Format version                           : Version 4 / Version 2
File size                                : 357 MiB
Duration                                 : 21 min 42 s
Overall bit rate                         : 2 301 kb/s
Writing application                      : google/video-file
Writing library                          : google/video-file

Video
ID                                       : 1
Format                                   : VP9
Codec ID                                 : V_VP9
Duration                                 : 21 min 42 s
Bit rate                                 : 2 203 kb/s
Width                                    : 854 pixels
Height                                   : 480 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 23.976 (24000/1001) FPS
Bits/(Pixel*Frame)                       : 0.224
Stream size                              : 342 MiB (96%)
Language                                 : English
Default                                  : Yes
Forced                                   : No


  



  It seems to be a good video file.

  



  I wanted to convert it with some video converters but none of them works. So I've tried to download ffmpeg, I renamed the video to "video.webm" and tried a lot of commands. But none of them worked.

  



  Here are informations from ffprobe command :

  



  C:\Users\XXX\Downloads\ffmpeg-20200424-a501947-win64-static\bin>ffprobe -i video.webm


  



  Results :

  



  ffprobe version git-2020-04-24-a501947 Copyright (c) 2007-2020 the FFmpeg developers
  built with gcc 9.3.1 (GCC) 20200328
  configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libdav1d --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libsrt --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvmaf --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --disable-w32threads --enable-libmfx --enable-ffnvcodec --enable-cuda-llvm --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth --enable-libopenmpt --enable-amf
  libavutil      56. 42.102 / 56. 42.102
  libavcodec     58. 81.100 / 58. 81.100
  libavformat    58. 42.101 / 58. 42.101
  libavdevice    58.  9.103 / 58.  9.103
  libavfilter     7. 79.100 /  7. 79.100
  libswscale      5.  6.101 /  5.  6.101
  libswresample   3.  6.100 /  3.  6.100
  libpostproc    55.  6.100 / 55.  6.100
[vp9 @ 00000284720d5f40] Invalid frame marker
    Last message repeated 111 times
[vp9 @ 00000284720d5f40] Profile 4 is not yet supported
[vp9 @ 00000284720d5f40] Invalid frame marker
    Last message repeated 6 times
[matroska,webm @ 00000284720cd840] decoding for stream 0 failed
[matroska,webm @ 00000284720cd840] Could not find codec parameters for stream 0 (Video: vp9 (Profile 0), none, 854x480): unspecified pixel format
Consider increasing the value for the 'analyzeduration' and 'probesize' options
Input #0, matroska,webm, from 'video.webm':
  Metadata:
    encoder         : google/video-file
  Duration: 00:21:42.05, start: 0.000000, bitrate: 2301 kb/s
    Stream #0:0(eng): Video: vp9 (Profile 0), none, 854x480, SAR 1:1 DAR 427:240, 23.98 fps, 23.98 tbr, 1k tbn, 1k tbc (default)
    Metadata:
      enc_key_id      : [24 characters I prefer not to display]


  



  If ever I initiate a conversion, I get :

  



  [vp9 @ 0000019038a80980] Invalid frame marker
[vp9 @ 0000019038c0fe40] Invalid frame marker
[vp9 @ 0000019038c193c0] Invalid frame marker
[vp9 @ 0000019038c1e780] Invalid frame marker
[vp9 @ 0000019038c29100] Invalid frame marker
[vp9 @ 0000019038c324c0] Invalid frame marker
[vp9 @ 0000019038c3d480] Invalid frame marker
[vp9 @ 0000019038c47280] Invalid frame marker
Error while decoding stream #0:0: Invalid data found when processing input
[vp9 @ 0000019038c4c080] Invalid frame marker
Error while decoding stream #0:0: Invalid data found when processing input
[vp9 @ 0000019038a80980] Invalid frame marker


  



  etc.
Then :

  



  Error while decoding stream #0:0: Resource temporarily unavailable
    Last message repeated 243 times
Error while decoding stream #0:0: Resource temporarily unavailabletrate=  -0.0kbits/s speed=N/A
    Last message repeated 306 times
Error while decoding stream #0:0: Resource temporarily unavailabletrate=  -0.0kbits/s speed=N/A
    Last message repeated 190 times


  



  I've already checked on the Internet solutions for the raised issues :

  



  

  • Invalid frame marker

  


  • unspecified pixel format

  


  • Consider increasing the value for the 'analyzeduration' and 'probesize' options

  


  



  But it didn't work in my case.

  



  Obviously, I can watch the video on YouTube when I'm logged into my purchase account. I presume they have a high level security algorithm, that's why I can't do nothing. Mayve there is something with the "enc_key_id" in the metadata, they get it and the video can only be read with it. I don't know.

  



  I find it unacceptable not to be able to use freely my purchased videos.

  



  Would anyone have an idea ?