Sur d’autres sites (7756)

• Anomalie #2024 (Nouveau) : langue des boutons d’admin

  7 avril 2011, par jluc -

  Sur spip.net, depuis plusieurs années, le texte des boutons d’admin m’apparaît en espagnol alors que tous mes paramétrages (espace perso, navigateur etc) sont en français. Je me souviens qu’un habitué d’IRC constatait également ce même (...)

• How to generate video as fast as possible with subtitles and audio on node.js + ffmpeg ?

  12 septembre 2018, par DSeregin

  Intro :

  We receive from the site some pieces of text
  Pieces arrive to node.js-server

  At the output we need to get a video, merged from all the pieces of text, voiced by the machine voice, with the added subtitles and audio substrate. So that user could be share this video in the social networks. MKV format doesn`t supported by VK.com

  The options that we have tried :
  1. Get all the text at once, generate the entire speech, create a file with subtitles, burn subtitles in the video .mp4 (vk.com does not support the .mkv container). It took 12 seconds of operations for a 45-second video on the local computer.
  2. Generate audio and video files for each piece of text (with added subtitles). It took one second for one piece of text. At the final request, we merge all pieces together. The last request (merging) took 2-3 seconds, which is already bearable.

  The second variant looks acceptable in terms of speed, but if you run 50 clients at the same time, then the computer (tested on a MacBook PRO 2013, 2.4 GHz i7, 8gb 1600 Mhz DDR3, SSD 256gb) processed only 1 piece from 1 client in 60 seconds (60 times slower), then the computer hung tight.

  • Generation of audio is done through Amazon Polly
  • Generate subtitles via https://github.com/gsantiago/subtitle.js#readme
  • From node.js we call ffmpeg using https://github.com/fluent-ffmpeg/node-fluent-ffmpeg
  • Resolution for video - 1280x720

  The commands we used :

  • Burn video subtitles and trim up to conditional 6 seconds (in the code send unix timestamp)

  ffmpeg -i import / back.mov -i export_0 / tmp.srt -scodec mov_text -t 6 export_0 / output.mov

  • Merging all audio

  ffmpeg -i audio1.mp3 .... -i audio15.mp3 merged.mp3

  • Overlay audio-substrate on the text

  ffmpeg -i merged.mp3 -i back.mp3 -filter_complex amerge -ac 2-c: a libmp3lame -q: a 4 -shortest audio.mp3

  • Merging all videos

  ffmpeg -i video.txt -f concat -c copy video.mp4

  • Overlay audio on video

  ffmpeg -i audio.mp3 -i video.mp4 -i test.mp4 -i export / output.mp3 -c: v copy -c: a aac -map 0: v: 0 -map 1: a: 0 -shortest output .mp4

  Questions that torment :

  1. Is it faster ?

  2. Can I use other codecs or methods of gluing without re-encoding ?

  3. Try to call ffmpeg directly without a wrapper ? (in fact, it gives 50-100 ms of speed)

  4. Try not to save to disk, and write data to Stream and have them glue together in the end ?

• Muxing in audio to gstreamer RTMP stream kills both video and Audio

  1er avril 2015, par Adam

  I need some genius help here - I’m trying to set up a live stream for my upcoming wedding... and I have it ALMOST working - audio seems to be the problem.

  This is my setup

  • Raspberry Pi Model B+
  • Logitech C920 (with onboard h264 encoding that I am utilising)
  • on-camera (C920) microphone
  • USB wifi to iPhone 4G connection
  • gstreamer1.0
  • Amazon EC2 Wowza RTMP server

  I have it all set up, but as soon as I mux in the audio, the streams wont play by any player.

  What Works :
  - my gstreamer pipeline WITHOUT the audio muxed in
  - Wowza receives a consistent stream, no failures
  - The various Flash players / iOS / Android and VLC all play back the video

  What doesnt :
  - enabling audio in the mux (using the pipeline below)
  - BUT gstreamer doesnt complain
  - BUT Wowza receives a consistent stream, no failures
  - The various flash players fail to play both Audio and Video. some just display the first video frame
  - VLC plays 1 video frame, and about 100ms of audio, then stops

  Ideally I’d like the muxed audio/video FLV stored on the SD card too in case the network goes down - but if the ’tee’ needs to be sacrificed to make it work, so be it.

  This is my current FAILING pipeline - I assume there’s something really stupid in it because I know practically nothing about gstreamer.... The first frame loads in all the players (except iOS.. which never shows anything)

  # set camera resolution to 720p, and the data format to H264 (alternatives are YUV and JPG)
  
  v4l2-ctl --device=/dev/video0 --set-fmt-video=width=1280,height=720,pixelformat=1
  
  # set the frame rate
  
  v4l2-ctl --device=/dev/video0 --set-parm=10
  
  
  
  gst-launch-1.0 -v -e uvch264src initial-bitrate=300000 average-bitrate=300000 device=/dev/video0 name=src auto-start=true src.vidsrc \
  
                  ! queue \
  
                  ! video/x-h264,width=1280,height=720,framerate=10/1 \
  
                  ! h264parse \
  
                  ! flvmux streamable=true name=mux \
  
                  ! queue \
  
                  ! tee name=t \
  
                  ! queue \
  
                  ! filesink location=/home/pi/wedding.flv t. \
  
                  ! queue \
  
                  ! rtmpsink location='rtmp://wowzaserver/live/wedding live=1' >>/home/pi/wedding.log 2>&1

  Some of the things I can’t really afford to change at this late stage are the encapsulation (FLV) and wowza RTMP because I’ve built everything around that...

  Please Help !! Thanks !

  UPDATE

  Given that I am also saving the FLV file, I have found that if I use ffmpeg to send that FLV file (using audio copy, video copy) to the RTMP server, everything works (but obviously its not live) ! So I am now starting to believe this is a problem with the way Gstreamer encapsulates RTMP - and by putting ffmpeg in the middle it fixes it... but it’s not live of course.
  Is it possible to pipe my output to ffmpeg and using ffmpeg’s RTMP ?