Recherche avancée

Sur d’autres sites (7237)

• FFMPEG failing in AWS Lambda

  18 février 2019, par Zaid Amir

  I am trying to create a transcoding function for short videos. The function is hosted on AWS Lambda. The problem is that AWS lambda seems to be missing something that FFMPEG requires, at least according to Amazon.

  I contacted Amazon earlier and this is their response to the issue :

  We found that the FFMPEG operations require at least libx264 and an
  acc library, both of which will have dependencies of their own. To
  troubleshoot the issue it will involve diving deeper into the full
  dependency chain. We can see that it works in the Amazon Linux
  environment however, the environment is similar but not identical to
  the lambda environment. There can be some dependencies that exist in
  Amazon Linux but not in lambda environment as Lambda runs on the
  container. Here, as FFmpeg is a third party software, diving deeper
  into the dependency chain and verifying the version compatibilities is
  very hard to do. Unfortunately going further, this is bound to go into
  architecture and code support which is out of AWS Support scope 1. I
  hope you understand our limitations. However should FFmpeg support
  have any questions specific to the Lambda platform, please do let us
  know and we will be happy to assist. We will be in better position to
  investigate further once you receive an update from the FFmpeg support
  suggesting an issue from Lambda end.

  Upon AWS suggestion, I contacted FFMPEG on the developers mailing list, my message was rejected with the reason being that its more suited to ffmpeg users mailing list than developers. I sent an email to ’ffmpeg-user@ffmpeg.org’ a week ago and did not get any response yet.

  I then went and built a dynamically linked ffmpeg version making sure to package all libraries, checked ddl on each one, then made a small lambda function that looped over all binaries and ddled each one of them, compared that to the output I got from Amazon Linux and the same dependencies/versions exists on both lambda and the AWS Linux instance yet ffmpeg still fails on lambda.

  You can find a detailed log file here : https://www.datafilehost.com/d/6e5e21bb

  And this is a sample of the errors I’m getting, repeated across the entire log file :

  2018-08-14T12:27:10.874Z [h264 @ 0x65c2fc0] concealing 2628 DC, 2628
  AC, 2628 MV errors in P frame

  2018-08-14T12:27:10.874Z [aac @ 0x65d2f00] channel element 2.11 is not
  allocated

  2018-08-14T12:27:10.874Z Error while decoding stream #0:1 : Invalid
  data found when processing input

  2018-08-14T12:27:10.874Z [h264 @ 0x67e86c0] Invalid NAL unit size
  (108085662 > 1649).

  2018-08-14T12:27:10.874Z [h264 @ 0x67e86c0] Error splitting the input
  into NAL units.

  2018-08-14T12:27:10.874Z [aac @ 0x65d2f00] channel element 2.0 is not
  allocated

  2018-08-14T12:27:10.874Z Error while decoding stream #0:1 : Invalid
  data found when processing input

  2018-08-14T12:27:10.874Z [h264 @ 0x68189c0] Invalid NAL unit size
  (71106974 > 1085).

  2018-08-14T12:27:10.874Z [h264 @ 0x68189c0] Error splitting the input
  into NAL units.

  2018-08-14T12:27:10.874Z [aac @ 0x65d2f00] Pulse tool not allowed in
  eight short sequence.

  This log is generated when trying to perform an HLS transcoding on this file : https://www.datafilehost.com/d/999a4492

  Note that the issue is not related to that file alone nor is it related to HLS, its general and happen on all videos and any ffmpeg command that tries to seek the stream, even tried extracting a single frame from a video using the simplest form possible for example : ffmpeg -ss 00:00:02 -I file.mp4 -vframes 1 -y output.jpg also fails with the same errors in the log file.

  Not sure how to debug this further. Tried enabling debug logs with ‘-loglevel debug’ but did not give me any extra info. Any help or suggestions

• EC2 for video-encoding

  3 mars 2022, par Naftuli Kay

  I have a potential job which will require me to do some video encoding with FFMPEG and x264. I'll have a series of files which I'll need to encode once, then I'll be able to bring down the instances. Since I'm not really sure of the resource utilization of x264 and FFMPEG, what kind of instances should I get ? I'm thinking either a

  



  


  High-CPU Extra Large Instance

  
 


  7 GB of memory
  
 20 EC2 Compute Units (8 virtual cores with 2.5 EC2 Compute Units each)
  
 1690 GB of instance storage
  
 64-bit platform
  
 I/O Performance : High
  
 API name : c1.xlarge

  


  



  or, alternatively a

  



  


  Cluster GPU Quadruple Extra Large Instance

  
 


  22 GB of memory
  
 33.5 EC2 Compute Units (2 x Intel Xeon X5570, quad-core “Nehalem” architecture)
  
 2 x NVIDIA Tesla “Fermi” M2050 GPUs
  
 1690 GB of instance storage
  
 64-bit platform
  
 I/O Performance : Very High (10 Gigabit Ethernet)
  
 API name : cg1.4xlarge

  


  



  What should I use ? Does x264/FFMPEG perform better with faster/more CPUs or does it really pound the GPU more ? In any case, it seems that the Cluster GPU seems to be the higher performance instance. What should I prefer ?

  


• Video moves sideways when captured raw from camera and piped into ffplay

  21 septembre 2018, par peetonn

  I’m trying to capture video from the camera using ffmpeg (macOS 10.12) and pipe it for preview into ffplay using rawvideo and -v copy options :

  ffmpeg -f avfoundation -pixel_format 0rgb -framerate 25 -video_size 1280x720 -i "0" -map 0:v -c copy -f rawvideo - | ffplay -f rawvideo -video_size 1280x720 -pixel_format 0rgb -i -

  Video captures just fine, however, it constantly moves sideways (see screenshot attached). What might the issue here ?

  

  UPDATE Full ffmpeg log output :

  $ ffmpeg -f avfoundation -pixel_format 0rgb -framerate 25 -video_size 1280x720 -i "0" -map 0:v -c copy -f rawvideo - | ffplay -f rawvideo -video_size 1280x720 -pixel_format 0rgb -i -
  
  ffmpeg version 4.0.2ffplay version 4.0.2 Copyright © 2003-2018 the FFmpeg developers Copyright © 2000-2018 the FFmpeg developers
  
  
  
    built with Apple LLVM version 9.0.0 (clang-900.0.39.2)
  
    built with Apple LLVM version 9.0.0 (clang-900.0.39.2)
  
    configuration: --prefix=/usr/local/Cellar/ffmpeg/4.0.2 --enable-shared --enable-pthreads --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-gpl --enable-ffplay --enable-libfontconfig --enable-libfreetype --enable-libmp3lame --enable-libx264 --enable-libxvid --enable-opencl --enable-videotoolbox --disable-lzma
  
    configuration: --prefix=/usr/local/Cellar/ffmpeg/4.0.2 --enable-shared --enable-pthreads --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-gpl --enable-ffplay --enable-libfontconfig --enable-libfreetype --enable-libmp3lame --enable-libx264 --enable-libxvid --enable-opencl --enable-videotoolbox --disable-lzma
  
    libavutil      56. 14.100 / 56. 14.100
  
    libavutil      56. 14.100 / 56. 14.100
  
    libavcodec     58. 18.100 / 58. 18.100
  
    libavformat    58. 12.100 / 58. 12.100
  
    libavcodec     58. 18.100 / 58. 18.100
  
    libavdevice    58.  3.100 / 58.  3.100
  
    libavformat    58. 12.100 / 58. 12.100
  
    libavfilter     7. 16.100 /  7. 16.100
  
    libavdevice    58.  3.100 / 58.  3.100
  
    libavresample   4.  0.  0 /  4.  0.  0
  
    libavfilter     7. 16.100 /  7. 16.100
  
    libswscale      5.  1.100 /  5.  1.100
  
    libswresample   3.  1.100 /  3.  1.100
  
    libavresample   4.  0.  0 /  4.  0.  0
  
    libpostproc    55.  1.100 / 55.  1.100
  
    libswscale      5.  1.100 /  5.  1.100
  
    libswresample   3.  1.100 /  3.  1.100
  
    libpostproc    55.  1.100 / 55.  1.100
  
  2018-09-20 09:33:28.013 ffmpeg[45781:16452887] Error loading /Library/Audio/Plug-Ins/HAL/SeratoVirtualAudioPlugIn.plugin/Contents/MacOS/SeratoVirtualAudioPlugIn:  dlopen(/Library/Audio/Plug-Ins/HAL/SeratoVirtualAudioPlugIn.plugin/Contents/MacOS/SeratoVirtualAudioPlugIn, 262): no suitable image found.  Did find:
  
      /Library/Audio/Plug-Ins/HAL/SeratoVirtualAudioPlugIn.plugin/Contents/MacOS/SeratoVirtualAudioPlugIn: mach-o, but wrong architecture
  
      /Library/Audio/Plug-Ins/HAL/SeratoVirtualAudioPlugIn.plugin/Contents/MacOS/SeratoVirtualAudioPlugIn: mach-o, but wrong architecture
  
  2018-09-20 09:33:28.013 ffmpeg[45781:16452887] Cannot find function pointer New_SHP_PlugIn for factory 834FC054-C1CC-11D6-BD01-00039315CD46 in CFBundle/CFPlugIn 0x7fe63b506d00 Audio/Plug-Ins/HAL/SeratoVirtualAudioPlugIn.plugin> (bundle, not loaded)
  
  2018-09-20 09:33:28.069 ffplay[45782:16452888] Error loading /Library/Audio/Plug-Ins/HAL/SeratoVirtualAudioPlugIn.plugin/Contents/MacOS/SeratoVirtualAudioPlugIn:  dlopen(/Library/Audio/Plug-Ins/HAL/SeratoVirtualAudioPlugIn.plugin/Contents/MacOS/SeratoVirtualAudioPlugIn, 262): no suitable image found.  Did find:
  
      /Library/Audio/Plug-Ins/HAL/SeratoVirtualAudioPlugIn.plugin/Contents/MacOS/SeratoVirtualAudioPlugIn: mach-o, but wrong architecture
  
      /Library/Audio/Plug-Ins/HAL/SeratoVirtualAudioPlugIn.plugin/Contents/MacOS/SeratoVirtualAudioPlugIn: mach-o, but wrong architecture
  
  2018-09-20 09:33:28.069 ffplay[45782:16452888] Cannot find function pointer New_SHP_PlugIn for factory 834FC054-C1CC-11D6-BD01-00039315CD46 in CFBundle/CFPlugIn 0x7f93f3c13020 Audio/Plug-Ins/HAL/SeratoVirtualAudioPlugIn.plugin> (bundle, not loaded)
  
  [avfoundation @ 0x7fe63c000000] Stream #0: not enough frames to estimate rate; consider increasing probesize
  
  Input #0, avfoundation, from '0':
  
    Duration: N/A, start: 1054.178167, bitrate: N/A
  
      Stream #0:0: Video: rawvideo ([0]RGB / 0x42475200), 0rgb, 1280x720, 1000k tbr, 1000k tbn, 1000k tbc
  
  Output #0, rawvideo, to 'pipe:':   0KB vq=    0KB sq=    0B f=0/0   
  
    Metadata:
  
      encoder         : Lavf58.12.100
  
      Stream #0:0: Video: rawvideo ([0]RGB / 0x42475200), 0rgb, 1280x720, q=2-31, 1000k tbr, 1000k tbn, 1000k tbc
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 ©
  
  Press [q] to stop, [?] for help
  
  Input #0, rawvideo, from 'pipe:':
  
    Duration: N/A, start: 0.000000, bitrate: 737280 kb/s
  
      Stream #0:0: Video: rawvideo ([0]RGB / 0x42475200), 0rgb, 1280x720, 737280 kb/s, 25 tbr, 25 tbn, 25 tbc
  
  frame=   16 fps=0.0 q=-1.0 size=   57600kB time=00:00:00.60 bitrate=786437.5kbits/s speed=1.frame=   29 fps= 28 q=-1.0 size=  104401kB time=00:00:01.12 bitrate=763617.4kbits/s speed=1.frame=   42 fps= 27 q=-1.0 size=  151201kB time=00:00:01.64 bitrate=755268.5kbits/s speed=1.frame=   55 fps= 26 q=-1.0 size=  198002kB time=00:00:02.16 bitrate=750939.5kbits/s speed=1.frame=   68 fps= 26 q=-1.0 size=  244802kB time=00:00:02.68 bitrate=748290.4kbits/s speed=1.av_interleaved_write_frame(): Broken pipe=    0KB sq=    0B f=0/0   
  
  Error writing trailer of pipe:: Broken pipe
  
  frame=   69 fps= 26 q=-1.0 Lsize=  247650kB time=00:00:02.72 bitrate=745863.6kbits/s speed=1.01x    
  
  video:248402kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
  
  Exiting normally, received signal 2.