Sur d’autres sites (10862)

• "Smooth" the ffmpeg showwaves video filter output

  24 décembre 2019, par goodytx

  I think I’m close to what I’m after, thanks to excellent answers like : FFMPEG : Fill/Change (part of) audio waveform color as per actual progress with respect to time progress ...but not quite there !

  I’m scripting the generation of a waveform video with showwaves, and overlaying that onto a static image background, turning the whole thing into video. All is well, except I’d like to "smooth" the waveform. In most tutorials/answers you will see jagged "peaks" in the waveform animation, as of course the audio data varies widely into peaks and troughs. (The differences expressed between the lowest and highest amplitude (I think) in each audio frame sample.) I’d like to get more of a consistent "flowing wave", without the sharp spikes up and down.

  Currently using the filter much as described in the previous link :

  [1:a]aformat=channel_layouts=mono,asplit[red][white]; \
  
  [red]showwaves=s=1280x100:rate=15:mode=cline:scale=sqrt:colors=0xff0000[red]; \

  Which results in the following (ignoring the red on white overlay, which I may drop) :

  Current v desired

  This generates the type of wave plot I want (solid vs a sine, for example), but I think I need to either tweak the audio stream or...possibly post filter the showwaves video stream (but I think the former) to get the effect I want. I tried to reduce the rate of showwaves but that just results in juddery video. So to me that feels like the audio data needs to be the changed factor.

  My limited audio knowledge leads me to think I should gain, compress, normalize, or all of the above, the audio input, which I have tried, but can’t seem to nail it. Keep in mind the audio stream in this filter chain is purely feeding the showwaves filter, so I can "trash" it as much as needed in order to get the visualization I want.

  I hope this all makes sense, and if I need to provide more info, please let me know. Thanks !

• FFMPEG cannot encode .MP4 to usable .Y4M RAW video : "Operation not permitted"

  26 janvier 2020, par Ham789

  I am running ffmpeg version 4.2.2 on macOS Sierra and I cannot decode a RAW video.

  First I create the .Y4M video :

  ffmpeg -y -i inputfolder/GH012088.MP4 temp_raw_video.Y4M

  Then I try to input it to ffmpeg :

  ffmpeg -i temp_raw_video.Y4M 

  However I get the following error in the terminal : temp_raw_video.Y4M: Operation not permitted

  I have checked the permissions for the ’temp_raw_video.Y4M’ file and I have both read and write permissions.

  I have tried the above with .MOV videos from an iPhone and it works fine.

  The problem seems to be with the .MP4 videos I am trying to convert. These videos were taken with a GoPro camera.

  What is going on here ? Please see the GH012088.MP4 file info below :

  [mov,mp4,m4a,3gp,3g2,mj2 @ 0x7fb9b6809400] Using non-standard frame rate 29/1
  
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'inputfolder/GH012088.MP4':
  
    Metadata:
  
      major_brand     : mp41
  
      minor_version   : 538120216
  
      compatible_brands: mp41
  
      creation_time   : 2019-12-28T14:12:04.000000Z
  
      firmware        : HD7.01.01.61.00
  
    Duration: 00:00:40.47, start: 0.000000, bitrate: 60267 kb/s
  
      Stream #0:0(eng): Video: h264 (High) (avc1 / 0x31637661), yuvj420p(pc, bt709), 3840x2160 [SAR 1:1 DAR 16:9], 60015 kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro AVC  
  
        encoder         : GoPro AVC encoder
  
        timecode        : 14:40:34:06
  
      Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 189 kb/s (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro AAC  
  
        timecode        : 14:40:34:06
  
      Stream #0:2(eng): Data: none (tmcd / 0x64636D74) (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro TCD  
  
        timecode        : 14:40:34:06
  
      Stream #0:3(eng): Data: bin_data (gpmd / 0x646D7067), 37 kb/s (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro MET  
  
      Stream #0:4(eng): Data: none (fdsc / 0x63736466), 10 kb/s (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro SOS 

  Here is the output log for creating the .Y4M :

  [mov,mp4,m4a,3gp,3g2,mj2 @ 0x7fa9da802200] Using non-standard frame rate 29/1
  
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'inputfolder/GH012088.MP4':
  
    Metadata:
  
      major_brand     : mp41
  
      minor_version   : 538120216
  
      compatible_brands: mp41
  
      creation_time   : 2019-12-28T14:12:04.000000Z
  
      firmware        : HD7.01.01.61.00
  
    Duration: 00:00:40.47, start: 0.000000, bitrate: 60267 kb/s
  
      Stream #0:0(eng): Video: h264 (High) (avc1 / 0x31637661), yuvj420p(pc, bt709), 3840x2160 [SAR 1:1 DAR 16:9], 60015 kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro AVC  
  
        encoder         : GoPro AVC encoder
  
        timecode        : 14:40:34:06
  
      Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 189 kb/s (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro AAC  
  
        timecode        : 14:40:34:06
  
      Stream #0:2(eng): Data: none (tmcd / 0x64636D74) (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro TCD  
  
        timecode        : 14:40:34:06
  
      Stream #0:3(eng): Data: bin_data (gpmd / 0x646D7067), 37 kb/s (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro MET  
  
      Stream #0:4(eng): Data: none (fdsc / 0x63736466), 10 kb/s (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro SOS  
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (h264 (native) -> wrapped_avframe (native))
  
  Press [q] to stop, [?] for help
  
  Output #0, yuv4mpegpipe, to 'temp_raw_video.Y4M':
  
    Metadata:
  
      major_brand     : mp41
  
      minor_version   : 538120216
  
      compatible_brands: mp41
  
      firmware        : HD7.01.01.61.00
  
      encoder         : Lavf58.29.100
  
      Stream #0:0(eng): Video: wrapped_avframe, yuvj420p, 3840x2160 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 29.97 fps, 29.97 tbn, 29.97 tbc (default)
  
      Metadata:
  
        creation_time   : 2019-12-28T14:12:04.000000Z
  
        handler_name    : GoPro AVC  
  
        timecode        : 14:40:34:06
  
        encoder         : Lavc58.54.100 wrapped_avframe
  
  frame=   43 fps=0.0 q=-0.0 size=  522240kB time=00:00:01.43 bitrate=2981801.3kbiframe=   92 fps= 90 q=-0.0 size= 1117696kB time=00:00:03.06 bitrate=2982723.8kbiframe=  144 fps= 95 q=-0.0 size= 1749504kB time=00:00:04.80 bitrate=2982837.3kbiframe=  190 fps= 94 q=-0.0 size= 2308352kB time=00:00:06.33 bitrate=2982809.6kbiframe=  241 fps= 95 q=-0.0 size= 2928128kB time=00:00:08.04 bitrate=2982978.5kbiframe=  287 fps= 94 q=-0.0 size= 3486976kB time=00:00:09.57 bitrate=2982937.8kbiframe=  336 fps= 95 q=-0.0 size= 4082176kB time=00:00:11.21 bitrate=2982837.3kbiframe=  388 fps= 96 q=-0.0 size= 4713984kB time=00:00:12.94 bitrate=2982864.2kbiframe=  436 fps= 96 q=-0.0 size= 5297152kB time=00:00:14.54 bitrate=frame= 1213 fps= 95 q=-0.0 Lsize=14737957kB time=00:00:40.47 bitrate=2983002.4kbits/s speed=3.19x      
  
  video:635kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 2321095.250000%

• Files created with "ffmpeg hevc_nvenc" do not play on TV. (with video codec SDK 9.1 of nvidia)

  29 janvier 2020, par Dashhh

  Problem

  • Files created with hevc_nvenc do not play on TV. (samsung smart tv, model unknown)
    Related to my ffmpeg build is below.

  FFmpeg build conf

  $ ffmpeg -buildconf
  
      --enable-cuda
  
      --enable-cuvid
  
      --enable-nvenc
  
      --enable-nonfree
  
      --enable-libnpp
  
      --extra-cflags=-I/path/cuda/include
  
      --extra-ldflags=-L/path/cuda/lib64
  
      --prefix=/prefix/ffmpeg_build
  
      --pkg-config-flags=--static
  
      --extra-libs='-lpthread -lm'
  
      --extra-cflags=-I/prefix/ffmpeg_build/include
  
      --extra-ldflags=-L/prefix/ffmpeg_build/lib
  
      --enable-gpl
  
      --enable-nonfree
  
      --enable-version3
  
      --disable-stripping
  
      --enable-avisynth
  
      --enable-libass
  
      --enable-libfontconfig
  
      --enable-libfreetype
  
      --enable-libfribidi
  
      --enable-libgme
  
      --enable-libgsm
  
      --enable-librubberband
  
      --enable-libshine
  
      --enable-libsnappy
  
      --enable-libssh
  
      --enable-libtwolame
  
      --enable-libwavpack
  
      --enable-libzvbi
  
      --enable-openal
  
      --enable-sdl2
  
      --enable-libdrm
  
      --enable-frei0r
  
      --enable-ladspa
  
      --enable-libpulse
  
      --enable-libsoxr
  
      --enable-libspeex
  
      --enable-avfilter
  
      --enable-postproc
  
      --enable-pthreads
  
      --enable-libfdk-aac
  
      --enable-libmp3lame
  
      --enable-libopus
  
      --enable-libtheora
  
      --enable-libvorbis
  
      --enable-libvpx
  
      --enable-libx264
  
      --enable-libx265
  
      --disable-ffplay
  
      --enable-libopenjpeg
  
      --enable-libwebp
  
      --enable-libxvid
  
      --enable-libvidstab
  
      --enable-libopenh264
  
      --enable-zlib
  
      --enable-openssl

  ---

  ffmpeg Command

  • Command about FFmpeg encoding

  ffmpeg -ss 1800 -vsync 0 -hwaccel cuvid -hwaccel_device 0 \
  
  -c:v h264_cuvid -i /data/input.mp4 -t 10 \
  
  -filter_complex "\
  
  [0:v]hwdownload,format=nv12,format=yuv420p,\
  
  scale=iw*2:ih*2" -gpu 0 -c:v hevc_nvenc -pix_fmt yuv444p16le -preset slow -rc cbr_hq -b:v 5000k -maxrate 7000k -bufsize 1000k -acodec aac -ac 2 -dts_delta_threshold 1000 -ab 128k -flags global_header ./makevideo_nvenc_hevc.mp4

  Full log about This Command - check this full log

  The reason for adding "-color_ " in the command is as follows.

  • HDR video after creating bt2020 + smpte2084 video using nvidia hardware accelerator. (I’m studying to make HDR videos. I’m not sure if this is right.)

  How can I make a video using ffmpeg hevc_nvenc and have it play on TV ?

  ---

  Things i’ve done

  Here’s what I’ve researched about why it doesn’t work.
   The header information is not properly included in the resulting video file. So I used a program called nvhsp to add SEI and VUI information inside the video. See below for the commands and logs used.

  nvhsp is open source for writing VUI and SEI bitstrings in raw video. nvhsp link

  # make rawvideo for nvhsp
  
  $  ffmpeg -vsync 0 -hwaccel cuvid -hwaccel_device 0 -c:v h264_cuvid \
  
  -i /data/input.mp4 -t 10 \
  
  -filter_complex "[0:v]hwdownload,format=nv12,\
  
  format=yuv420p,scale=iw*2:ih*2" \
  
  -gpu 0 -c:v hevc_nvenc -f rawvideo output_for_nvhsp.265
  
  
  
  # use nvhsp
  
  $ python nvhsp.py ./output_for_nvhsp.265 -colorprim bt2020 \
  
  -transfer smpte-st-2084 -colormatrix bt2020nc \
  
  -maxcll "1000,300" -videoformat ntsc -full_range tv \
  
  -masterdisplay "G (13250,34500) B (7500,3000 ) R (34000,16000) WP (15635,16450) L (10000000,1)" \
  
  ./after_nvhsp_proc_output.265
  
  
  
  Parsing the infile:
  
  
  
  ==========================
  
  
  
  Prepending SEI data
  
  Starting new SEI NALu ...
  
  SEI message with MaxCLL = 1000 and MaxFall = 300 created in SEI NAL
  
  SEI message Mastering Display Data G (13250,34500) B (7500,3000) R (34000,16000) WP (15635,16450) L (10000000,1) created in SEI NAL
  
  Looking for SPS ......... [232, 22703552]
  
  SPS_Nals_addresses [232, 22703552]
  
  SPS NAL Size 488
  
  Starting reading SPS NAL contents
  
  Reading of SPS NAL finished. Read 448 of SPS NALu data.
  
  
  
  Making modified SPS NALu ...
  
  Made modified SPS NALu-OK
  
  New SEI prepended
  
  Writing new stream ...
  
  Progress: 100%
  
  =====================
  
  Done!
  
  
  
  File nvhsp_after_output.mp4 created.
  
  
  
  # after process
  
  $ ffmpeg -y -f rawvideo -r 25 -s 3840x2160 -pix_fmt yuv444p16le -color_primaries bt2020 -color_trc smpte2084  -colorspace bt2020nc -color_range tv -i ./1/after_nvhsp_proc_output.265 -vcodec copy  ./1/result.mp4 -hide_banner
  
  
  
  Truncating packet of size 49766400 to 3260044
  
  [rawvideo @ 0x40a6400] Estimating duration from bitrate, this may be inaccurate
  
  Input #0, rawvideo, from './1/nvhsp_after_output.265':
  
    Duration: N/A, start: 0.000000, bitrate: 9953280 kb/s
  
      Stream #0:0: Video: rawvideo (Y3[0][16] / 0x10003359), yuv444p16le(tv, bt2020nc/bt2020/smpte2084), 3840x2160, 9953280 kb/s, 25 tbr, 25 tbn, 25 tbc
  
  [mp4 @ 0x40b0440] Could not find tag for codec rawvideo in stream #0, codec not currently supported in container
  
  Could not write header for output file #0 (incorrect codec parameters ?): Invalid argument
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (copy)
  
      Last message repeated 1 times

  Goal

  • I want to generate matadata normally when encoding a video through hevc_nvenc.

  • I want to create a video through hevc_nvenc and play HDR Video on smart tv with 10bit color depth support.

  ---

  Additional

  • Is it normal for ffmpeg hevc_nvenc not to generate metadata in the resulting video file ? or is it a bug ?

  • Please refer to the image below. (*’알 수 없음’ meaning ’unknown’)

    • if you need more detail file info, check this Gist Link (by ffprobe)
      

  • However, if you encode a file in libx265, the attribute information is entered correctly as shown below.

    • if you need more detail file info, check this Gist Link
      

  However, when using hevc_nvenc, all information is missing.

  • i used option -show_streams -show_programs -show_format -show_data -of json -show_frames -show_log 56 at ffprobe