Recherche avancée

Sur d’autres sites (7149)

• ffmpeg : concatinating files creates audio artefacts

  28 octobre 2022, par LML

  I'm currently trying to create a video out of multiple short video files. However, the final video always has audio artefacts, where it sounds like a short high pitch or echo at certain times during the audio. All the audio is a text-to-speech generated voice. No music. The artefacts appear sometimes more, sometimes less. But I would obviously prefer to have 0 of it.

  


  My starting point is a long audio file (mono with audio codec "mp3" according to ffprobe). Within that file are a bunch of short pauses of 4-5 seconds. I detect the silences and create individual audio files from there. Afterwards I create an mp4 file with this audio and a still image. Up to this point, the audio is perfectly fine and sounds the exact same as in the original file.

  


  After this I want to create the final video : each of the individual parts added into one long video. There is a transition between each file to mark the changing of image and audio. But even when skipping the transition and simply adding all of these clips that were generated the same way together, the artefacts are still present.

  


  The commands I use to create the different files.

  


  Create individual audio files :
.\ffmpeg.exe -y -hide_banner -i TTSAudio.mp3 -ss 359.944 -to 372.02479 -c copy partXY.mp3

  


  Create individual video files by using a .png file as the video stream and the partXY.mp3 as the audio stream :
.\ffmpeg.exe -y -hide_banner -framerate 30 -loop 1 -i XY_full.png -i partXY.mp3 -c:v libx265 -c:a copy -shortest partXY.mp4

  


  For concatenating the files :
.\ffmpeg.exe -y -hide_banner -i part000.mp4 -i part001.mp4 -i part002.mp4 -filter_complex "[0:v] [0:a] [1:v] [1:a] [2:v] [2:a] concat=n=3:v=1:a=1 [v] [a]" -map "[v]" -map "[a]" -c:v copy -c:a copy final_video.mp4

  


  I've tried a lot of different things and codecs for the audio, without any luck. I use h265, as using h264 was causing weird video artefacts after uploading the file to YouTube.
I have tried reencoding, instead of copying (-c:a copy) at various stages, especially the final video. All without any luck.
I've used the different concatenation where you provide a list of files, which created a whole different set of problems.

  


  I've managed to filter the artefacts out by using -af "lowpass=f=2800", but that changes the voice a lot. I was also not able to notice the pitch visually when opening the audio in audacity, for example.

  


  Example :
https://soundcloud.com/thelml/sets/ffmpeg-audio-artefacts/s-LNr6UaMPgz9?si=f7b30e1e64bf4333ad055fa1fe21e9ec
Due to the files being so short, I seem to have to sometimes have to replay the bugged file to hear the artefact.

  


  So my question is : how do I fix this, without using a lowpass that basically changes the whole voice ?

  


• hw_base_encode : make recon_frames_ref optional

  30 août 2024, par Lynne

  hw_base_encode : make recon_frames_ref optional
  Vulkan supports some stupidly odd hardware, that unfortunately,
  
  most modern GPUs happen to be.
  
  The DPB images for encoders may be required to be preallocated
  
  all at once, and rather than be individual frames, be layers of
  
  a single frame.
  As the hw_base_encode code is written with the thought that either
  
  the driver or the device itself supports sane image allocation,
  
  Vulkan does not leave us with this option.
  So, in the case that the hardware does not support individual
  
  frames to be used as DPBs, make the DBP frames context optional,
  
  and let the subsystem manage this.
  

  • [DH] libavcodec/hw_base_encode.c

• Can I convert a django video upload from a form using ffmpeg before storing the video ?

  5 mai 2014, par GetItDone

  I’ve been stuck for weeks trying to use ffmpeg to convert user uploaded videos to flv. I use heroku to host my website, and store my static and media files on amazon S3 with s3boto. The initial video file will upload fine, however when I retrieve the video and run a celery task (in the same view where the initial video file is uploaded), the new file won’t store on S3. I’ve been trying to get this to work for over a month, with no luck, and really no good resources available for learning how to do this, so I figure maybe if I can get the ffmpeg task to run before storing the video I may be able to get it to work. Unfortunately I’m still not a very advanced at python (or django), so I don’t even know if/how this is possible. Anyone have any ideas ? I am willing to use any solution at this point no matter how ugly, as long as it successfully takes video uploads and converts to flv using ffmpeg, with the resulting file being stored on S3. It doesn’t seem that my situation is very common, because no matter where I look, I cannot find a solution that explains what I should be trying to do. Therefore I will be very appreciative of any guidance. Thanks. My relevant code follows :

  #models.py
  
  def content_file_name(instance, filename):
  
      ext = filename.split('.')[-1]
  
      new_file_name = "remove%s.%s" % (uuid.uuid4(), ext)
  
      return '/'.join(['videos', instance.teacher.username, new_file_name])
  
  
  
  class BroadcastUpload(models.Model):
  
      title = models.CharField(max_length=50, verbose_name=_('Title'))
  
      description = models.TextField(max_length=100, verbose_name=_('Description'))
  
      teacher = models.ForeignKey(User, null=True, blank=True, related_name='teacher')
  
      created_date = models.DateTimeField(auto_now_add=True)
  
      video_upload = models.FileField(upload_to=content_file_name)
  
      flvfilename = models.CharField(max_length=100, null=True, blank=True)
  
      videothumbnail = models.CharField(max_length=100, null=True, blank=True)
  
  
  
  #tasks.py
  
  @task(name='celeryfiles.tasks.convert_flv')
  
  def convert_flv(video_id):
  
      video = BroadcastUpload.objects.get(pk=video_id)
  
      print "ID: %s" % video.id
  
      id = video.id
  
      print "VIDEO NAME: %s" % video.video_upload.name
  
      teacher = video.teacher
  
      print "TEACHER: %s" % teacher
  
      filename = video.video_upload
  
      sourcefile = "%s%s" % (settings.MEDIA_URL, filename)
  
      vidfilename = "%s_%s.flv" % (teacher, video.id)
  
      targetfile = "%svideos/flv/%s" % (settings.MEDIA_URL, vidfilename)
  
      ffmpeg = "ffmpeg -i %s %s" % (sourcefile, vidfilename)
  
      try:
  
          ffmpegresult = subprocess.call(ffmpeg)
  
          #also tried separately with following line:
  
          #ffmpegresult = commands.getoutput(ffmpeg)
  
          print "---------------FFMPEG---------------"
  
          print "FFMPEGRESULT: %s" % ffmpegresult
  
      except Exception as e:
  
          ffmpegresult = None
  
          print("Failed to convert video file %s to %s" % (sourcefile, targetfile))
  
          print(traceback.format_exc())
  
      video.flvfilename = vidfilename
  
      video.save()
  
  
  
  @task(name='celeryfiles.tasks.ffmpeg_image')        
  
  def ffmpeg_image(video_id):
  
      video = BroadcastUpload.objects.get(pk=video_id)
  
      print "ID: %s" %video.id
  
      id = video.id
  
      print "VIDEO NAME: %s" % video.video_upload.name
  
      teacher = video.teacher
  
      print "TEACHER: %s" % teacher
  
      filename = video.video_upload
  
      sourcefile = "%s%s" % (settings.MEDIA_URL, filename)
  
      imagefilename = "%s_%s.png" % (teacher, video.id)
  
      thumbnailfilename = "%svideos/flv/%s" % (settings.MEDIA_URL, thumbnailfilename)
  
      grabimage = "ffmpeg -y -i %s -vframes 1 -ss 00:00:02 -an -vcodec png -f rawvideo -s 320x240 %s" % (sourcefile, thumbnailfilename)
  
      try:        
  
           videothumbnail = subprocess.call(grabimage)
  
           #also tried separately following line:
  
           #videothumbnail = commands.getoutput(grabimage)
  
           print "---------------IMAGE---------------"
  
           print "VIDEOTHUMBNAIL: %s" % videothumbnail
  
      except Exception as e:
  
           videothumbnail = None
  
           print("Failed to convert video file %s to %s" % (sourcefile, thumbnailfilename))
  
           print(traceback.format_exc())
  
      video.videothumbnail = imagefilename
  
      video.save()
  
  
  
  #views.py
  
  def upload_broadcast(request):
  
      if request.method == 'POST':
  
          form = BroadcastUploadForm(request.POST, request.FILES)
  
          if form.is_valid():
  
              upload=form.save()
  
              video_id = upload.id
  
              image_grab = ffmpeg_image.delay(video_id)
  
              video_conversion = convert_flv.delay(video_id)
  
              return HttpResponseRedirect('/current_classes/')
  
      else:
  
          form = BroadcastUploadForm(initial={'teacher': request.user,})
  
      return render_to_response('videos/create_video.html', {'form': form,}, context_instance=RequestContext(request))
  
  
  
  #settings.py
  
  DEFAULT_FILE_STORAGE = 'myapp.s3utils.MediaRootS3BotoStorage'
  
  DEFAULT_S3_PATH = "media"
  
  STATICFILES_STORAGE = 'myapp.s3utils.StaticRootS3BotoStorage'
  
  STATIC_S3_PATH = "static"
  
  AWS_STORAGE_BUCKET_NAME = 'my_bucket'
  
  CLOUDFRONT_DOMAIN = 'domain.cloudfront.net'
  
  AWS_ACCESS_KEY_ID = 'MY_KEY_ID'
  
  AWS_SECRET_ACCESS_KEY = 'MY_SECRET_KEY'
  
  MEDIA_ROOT = '/%s/' % DEFAULT_S3_PATH
  
  MEDIA_URL = 'http://%s/%s/' % (CLOUDFRONT_DOMAIN, DEFAULT_S3_PATH)
  
  ...
  
  
  
  #s3utils.py
  
  from storages.backends.s3boto import S3BotoStorage
  
  from django.utils.functional import SimpleLazyObject
  
  
  
  StaticRootS3BotoStorage = lambda: S3BotoStorage(location='static')
  
  MediaRootS3BotoStorage  = lambda: S3BotoStorage(location='media')

  I can add any other info if needed to help me solve my problem.