Sur d’autres sites (7457)

• vf_dnn_processing.c : add dnn backend openvino

  25 mai 2020, par Guo, Yejun

  vf_dnn_processing.c : add dnn backend openvino
  We can try with the srcnn model from sr filter.
  
  1) get srcnn.pb model file, see filter sr
  
  2) convert srcnn.pb into openvino model with command :
  
  python mo_tf.py —input_model srcnn.pb —data_type=FP32 —input_shape [1,960,1440,1] —keep_shape_ops
  See the script at https://github.com/openvinotoolkit/openvino/tree/master/model-optimizer
  
  We'll see srcnn.xml and srcnn.bin at current path, copy them to the
  
  directory where ffmpeg is.
  I have also uploaded the model files at https://github.com/guoyejun/dnn_processing/tree/master/models
  3) run with openvino backend :
  
  ffmpeg -i input.jpg -vf format=yuv420p,scale=w=iw*2:h=ih*2,dnn_processing=dnn_backend=openvino:model=srcnn.xml:input=x:output=srcnn/Maximum -y srcnn.ov.jpg
  
  (The input.jpg resolution is 720*480)
  Also copy the logs on my skylake machine (4 cpus) locally with openvino backend
  
  and tensorflow backend. just for your information.
  $ time ./ffmpeg -i 480p.mp4 -vf format=yuv420p,scale=w=iw*2:h=ih*2,dnn_processing=dnn_backend=tensorflow:model=srcnn.pb:input=x:output=y -y srcnn.tf.mp4
  
  …
  
  frame=  343 fps=2.1 q=31.0 Lsize=    2172kB time=00:00:11.76 bitrate=1511.9kbits/s speed=0.0706x
  
  video:1973kB audio:187kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead : 0.517637%
  
  [aac @ 0x2f5db80] Qavg : 454.353
  
  real    2m46.781s
  
  user    9m48.590s
  
  sys     0m55.290s
  $ time ./ffmpeg -i 480p.mp4 -vf format=yuv420p,scale=w=iw*2:h=ih*2,dnn_processing=dnn_backend=openvino:model=srcnn.xml:input=x:output=srcnn/Maximum -y srcnn.ov.mp4
  
  …
  
  frame=  343 fps=4.0 q=31.0 Lsize=    2172kB time=00:00:11.76 bitrate=1511.9kbits/s speed=0.137x
  
  video:1973kB audio:187kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead : 0.517640%
  
  [aac @ 0x31a9040] Qavg : 454.353
  
  real    1m25.882s
  
  user    5m27.004s
  
  sys     0m0.640s
  Signed-off-by : Guo, Yejun <yejun.guo@intel.com>
  
  Signed-off-by : Pedro Arthur <bygrandao@gmail.com>
  

  • [DH] doc/filters.texi
  • [DH] libavfilter/vf_dnn_processing.c

• How to get a list of video devices with a particular VendorID and/or ProductID using FFmpeg (on Mac OS)

  26 mai 2020, par mcgregor94086

  The master task :

  



  I am writing software for a multiple USB camera array. The camera may be connected to a CPU that has other USB cameras builtin or attached. I need to capture one 1920x1080 JPG image from EACH of MY array's cameras into a directory of images - but I need to EXCLUDE any OTHER cameras when taking pictures.

  



  Right now I am trying to implement for MacOS, but in the future I will be implementing for Windows, Linux, iOS and Android.

  



  What is known :

  



  I know the VendorID, ProductID and UniqueID (reported by the MacOS USB system System Hardware Report) for each of the cameras in the camera array.

  



  UNIQUESKY_CAR_CAMERA #5:

  Model ID: UVC Camera VendorID_7119 ProductID_2825
  Unique ID:    0x143400001bcf0b09

UNIQUESKY_CAR_CAMERA #6:

  Model ID: UVC Camera VendorID_7119 ProductID_2825
  Unique ID:    0x143300001bcf0b09


  



  The problem code :

  



  I made the following call to FFmpeg

  



  ffmpeg -nostdin -hide_banner -an -sn -dn  -f avfoundation -list_devices true -I 1


  



  I received the following result in stderr :

  



      [AVFoundation indev @ 0x7fc870e21800] AVFoundation video devices:
    [AVFoundation indev @ 0x7fc870e21800] [0] FaceTime HD Camera (Built-in)
    [AVFoundation indev @ 0x7fc870e21800] [1] UNIQUESKY_CAR_CAMERA #5
    [AVFoundation indev @ 0x7fc870e21800] [2] UNIQUESKY_CAR_CAMERA #6
    [AVFoundation indev @ 0x7fc870e21800] [3] Capture screen 0
    [AVFoundation indev @ 0x7fc870e21800] [4] Capture screen 1
    [AVFoundation indev @ 0x7fc870e21800] AVFoundation audio devices:
    [AVFoundation indev @ 0x7fc870e21800] [0] MacBook Pro Microphone
    1: Input/output error


  



  Of these devices listed in the output, I happen to know (in this particular TEST CASE) that the cameras in my test array, are only these two :

  



  [1] UNIQUESKY_CAR_CAMERA #5
[2] UNIQUESKY_CAR_CAMERA #6


  



  With this knowledge, I can select the indices (1 2) that I need, and then use the following code to capture an image from each :

  



  for i in 1 2; 
do
    ffmpeg  -y -hide_banner  -f avfoundation  -r 15 -video_size 1920x1080 -i 1  -f image2 -qscale:v 1 -qmin 1 -qmax 1 -frames:v 1 img$i.jpg;
done



  



  Unfortunately, in production use (i.e. outside of this test case), I CAN NOT rely on cameras all identifying themselves with the same TEXT "name" prefix (e.g. "UNIQUESKY_CAR_CAMERA"), so I can't just use grep to select the ones I want.

  



  But I CAN be sure that I will know their VendorID, ProductID and UniqueIDs.

  



  So, IF I could get

  



  ffmpeg  -nostdin -hide_banner -an -sn -dn  -f avfoundation -list_devices true -I 1


  



  to also list the VendorID and ProductID, then I could grep for those values.

  



  Is this solution possible ? I can't find syntax in the documentation or examples for how to set such limits.

  



  ALTERNATIVELY : if I could specify to FFmpeg -list_devices to limit the output list to just those with my specified VendorID and ProductIDs then I could easily get the list of device indices I will need for the succeeding image extraction.

  



  Is this solution possible ? I can't find syntax in the documentation or examples for how to set such limits.

  



  Special Note :
  
The cameras I am using are all 1920x1080, and that resolution is necessary for my application. As has been noted by many Mac users on the web, other image capture programs (such as imagesnap) sometimes capture images at lower resolution (1024x720) than the cameras are capable of, and will not capture images at higher resolutions such as (1920x1080). For this reason, and because it is available on ALL the OS platforms of interest to us, I chose to use FFmpeg.

  


• Remove black bars from DV video using ffmpeg [closed]

  2 juillet 2020, par AustinMaxi1750

  I have copied all my Panasonic DV videos (PAL) from the 1990s to my PC as 'dv avi' using Windows movie maker in the original quality (approx 13GB per hour of video).

  


  At the time the recordings were made I set the Panasonic camera to 16:9. However searching various forums indicates it was an illusion of 16:9 and black bars were superimposed on the 4:3 picture to give a cinematic feel. I have read also that the DV pixels are not square.

  


  As a result all my 16:9 recordings have black bars at the top and bottom when viewed on a 16:9 monitor. The file properties are as follows :

  


  Frame width : 720
Frame height : 576

  


  Is there a code in ffmpeg to remove the black bars ?

  


  I attach an example of what I have :
image with black bars

  


  and an example of what I want to achieve :
image without black bars

  


  I also want to convert the format without loss of quality so I can watch the videos without the black bars on a modern smart TV. My TV cannot play back DV AVI.