Recherche avancée

Sur d’autres sites (9810)

• Revision 3202 : Et on update la conf d’emballe_medias tant qu’à faire

  6 avril 2010, par kent1 — Log

  Et on update la conf d’emballe_medias tant qu’à faire

• AWS lambda mp4 thumbnail generator using ffmpeg - incorrect format generated

  10 avril 2021, par sam bhandu

  I am trying to create a thumbnail generator for every mp4 file uploaded to the s3 bucket. I have been following this post published by AWS. The code works fine for the transcoding video file. I changed the code to generate a thumbnail. The code does generate a file but it is an invalid image type.

  


  import json
import os
import subprocess
import shlex
import boto3
import uuid

S3_DESTINATION_BUCKET = "example-bucket"
SIGNED_URL_TIMEOUT = 60

def lambda_handler(event, context):

    # s3_source_bucket = event['Records'][0]['s3']['bucket']['name']
    # s3_source_key = event['Records'][0]['s3']['object']['key']
    # s3_source_basename = os.path.splitext(os.path.basename(s3_source_key))[0]
    # s3_destination_filename = s3_source_basename + "_cfr.ts"
    
    hex_c = uuid.uuid4()
    s3_destination_filename = '/{}/{}.{}'.format('tmp',hex_c, 'jpg')
    s3_client = boto3.client('s3')
    s3_media_url = 'https://s3-us-west-2.amazonaws.com/example-bucket/videos/presentations/testing.mp4'
    ffmpeg_cmd = "/opt/bin/ffmpeg -i \"" + s3_media_url + "\" -ss 00:00:02 -vframes 1  \"" + s3_destination_filename + "\""
    # ffmpeg_cmd = "/opt/bin/ffmpeg -i \"" + s3_source_signed_url + "\" -f mpegts -c:v copy -af aresample=async=1:first_pts=0 -"
    
    command1 = shlex.split(ffmpeg_cmd)
    p1 = subprocess.run(command1, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
   
    resp = s3_client.put_object(Body=s3_destination_filename, Bucket=S3_DESTINATION_BUCKET, Key='{}{}'.format(hex_c, '.jpg'))
    return {
        'statusCode': 200,
        'body': json.dumps('Processing complete successfully')
    }


  


  Output is as :

  


  {
  "statusCode": 200,
  "body": "\"Processing complete successfully\""
}

Function Logs
START RequestId: b73aaacc-5da5-417a-9f98-5def438dee96 Version: $LATEST
ffmpeg version 4.1.3-static https://johnvansickle.com/ffmpeg/  Copyright (c) 2000-2019 the FFmpeg developers
  built with gcc 6.3.0 (Debian 6.3.0-18+deb9u1) 20170516
  configuration: --enable-gpl --enable-version3 --enable-static --disable-debug --disable-ffplay --disable-indev=sndio --disable-outdev=sndio --cc=gcc-6 --enable-fontconfig --enable-frei0r --enable-gnutls --enable-gmp --enable-gray --enable-libaom --enable-libfribidi --enable-libass --enable-libvmaf --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librubberband --enable-libsoxr --enable-libspeex --enable-libvorbis --enable-libopus --enable-libtheora --enable-libvidstab --enable-libvo-amrwbenc --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzvbi --enable-libzimg
  libavutil      56. 22.100 / 56. 22.100
  libavcodec     58. 35.100 / 58. 35.100
  libavformat    58. 20.100 / 58. 20.100
  libavdevice    58.  5.100 / 58.  5.100
  libavfilter     7. 40.101 /  7. 40.101
  libswscale      5.  3.100 /  5.  3.100
  libswresample   3.  3.100 /  3.  3.100
  libpostproc    55.  3.100 / 55.  3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'https://s3-us-west-2.amazonaws.com/example-bucket/videos/presentations/testing.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 1
    compatible_brands: isomavc1mp42
    creation_time   : 2020-04-17T18:31:33.000000Z
  Duration: 00:00:33.07, start: 0.000000, bitrate: 90 kb/s
    Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt709), 854x480 [SAR 1:1 DAR 427:240], 23 kb/s, 30 fps, 30 tbr, 30 tbn, 60 tbc (default)
    Metadata:
      creation_time   : 2020-04-17T18:31:29.000000Z
    Stream #0:1(eng): Audio: aac (HE-AAC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 64 kb/s (default)
    Metadata:
      creation_time   : 2020-04-17T18:31:29.000000Z
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
[swscaler @ 0x67ddc40] deprecated pixel format used, make sure you did set range correctly
Output #0, image2, to '/tmp/4633bb13-4a15-49b7-a445-d910bebaddf6.jpg':
  Metadata:
    major_brand     : isom
    minor_version   : 1
    compatible_brands: isomavc1mp42
    encoder         : Lavf58.20.100
    Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 854x480 [SAR 1:1 DAR 427:240], q=2-31, 200 kb/s, 30 fps, 30 tbn, 30 tbc (default)
    Metadata:
      creation_time   : 2020-04-17T18:31:29.000000Z
      encoder         : Lavc58.35.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: -1
frame=    0 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x    
frame=    0 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x    
frame=    0 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x    
frame=    1 fps=0.4 q=6.3 Lsize=N/A time=00:00:00.03 bitrate=N/A speed=0.0149x    
video:14kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
END RequestId: b73aaacc-5da5-417a-9f98-5def438dee96
REPORT RequestId: b73aaacc-5da5-417a-9f98-5def438dee96  Duration: 6349.25 ms    Billed Duration: 6350 ms    Memory Size: 155 MB Max Memory Used: 123 MB Init Duration: 368.12 ms

Request ID
b73aaacc-5da5-417a-9f98-5def438dee96


  


  An image file is uploaded to the S3 folder, but when I try to open it flags an invalid file format. The file size is only 40.0 Bytes.
S3 bucket image folder
invalid file format

  


• Can I convert a django video upload from a form using ffmpeg before storing the video ?

  5 mai 2014, par GetItDone

  I’ve been stuck for weeks trying to use ffmpeg to convert user uploaded videos to flv. I use heroku to host my website, and store my static and media files on amazon S3 with s3boto. The initial video file will upload fine, however when I retrieve the video and run a celery task (in the same view where the initial video file is uploaded), the new file won’t store on S3. I’ve been trying to get this to work for over a month, with no luck, and really no good resources available for learning how to do this, so I figure maybe if I can get the ffmpeg task to run before storing the video I may be able to get it to work. Unfortunately I’m still not a very advanced at python (or django), so I don’t even know if/how this is possible. Anyone have any ideas ? I am willing to use any solution at this point no matter how ugly, as long as it successfully takes video uploads and converts to flv using ffmpeg, with the resulting file being stored on S3. It doesn’t seem that my situation is very common, because no matter where I look, I cannot find a solution that explains what I should be trying to do. Therefore I will be very appreciative of any guidance. Thanks. My relevant code follows :

  #models.py
  
  def content_file_name(instance, filename):
  
      ext = filename.split('.')[-1]
  
      new_file_name = "remove%s.%s" % (uuid.uuid4(), ext)
  
      return '/'.join(['videos', instance.teacher.username, new_file_name])
  
  
  
  class BroadcastUpload(models.Model):
  
      title = models.CharField(max_length=50, verbose_name=_('Title'))
  
      description = models.TextField(max_length=100, verbose_name=_('Description'))
  
      teacher = models.ForeignKey(User, null=True, blank=True, related_name='teacher')
  
      created_date = models.DateTimeField(auto_now_add=True)
  
      video_upload = models.FileField(upload_to=content_file_name)
  
      flvfilename = models.CharField(max_length=100, null=True, blank=True)
  
      videothumbnail = models.CharField(max_length=100, null=True, blank=True)
  
  
  
  #tasks.py
  
  @task(name='celeryfiles.tasks.convert_flv')
  
  def convert_flv(video_id):
  
      video = BroadcastUpload.objects.get(pk=video_id)
  
      print "ID: %s" % video.id
  
      id = video.id
  
      print "VIDEO NAME: %s" % video.video_upload.name
  
      teacher = video.teacher
  
      print "TEACHER: %s" % teacher
  
      filename = video.video_upload
  
      sourcefile = "%s%s" % (settings.MEDIA_URL, filename)
  
      vidfilename = "%s_%s.flv" % (teacher, video.id)
  
      targetfile = "%svideos/flv/%s" % (settings.MEDIA_URL, vidfilename)
  
      ffmpeg = "ffmpeg -i %s %s" % (sourcefile, vidfilename)
  
      try:
  
          ffmpegresult = subprocess.call(ffmpeg)
  
          #also tried separately with following line:
  
          #ffmpegresult = commands.getoutput(ffmpeg)
  
          print "---------------FFMPEG---------------"
  
          print "FFMPEGRESULT: %s" % ffmpegresult
  
      except Exception as e:
  
          ffmpegresult = None
  
          print("Failed to convert video file %s to %s" % (sourcefile, targetfile))
  
          print(traceback.format_exc())
  
      video.flvfilename = vidfilename
  
      video.save()
  
  
  
  @task(name='celeryfiles.tasks.ffmpeg_image')        
  
  def ffmpeg_image(video_id):
  
      video = BroadcastUpload.objects.get(pk=video_id)
  
      print "ID: %s" %video.id
  
      id = video.id
  
      print "VIDEO NAME: %s" % video.video_upload.name
  
      teacher = video.teacher
  
      print "TEACHER: %s" % teacher
  
      filename = video.video_upload
  
      sourcefile = "%s%s" % (settings.MEDIA_URL, filename)
  
      imagefilename = "%s_%s.png" % (teacher, video.id)
  
      thumbnailfilename = "%svideos/flv/%s" % (settings.MEDIA_URL, thumbnailfilename)
  
      grabimage = "ffmpeg -y -i %s -vframes 1 -ss 00:00:02 -an -vcodec png -f rawvideo -s 320x240 %s" % (sourcefile, thumbnailfilename)
  
      try:        
  
           videothumbnail = subprocess.call(grabimage)
  
           #also tried separately following line:
  
           #videothumbnail = commands.getoutput(grabimage)
  
           print "---------------IMAGE---------------"
  
           print "VIDEOTHUMBNAIL: %s" % videothumbnail
  
      except Exception as e:
  
           videothumbnail = None
  
           print("Failed to convert video file %s to %s" % (sourcefile, thumbnailfilename))
  
           print(traceback.format_exc())
  
      video.videothumbnail = imagefilename
  
      video.save()
  
  
  
  #views.py
  
  def upload_broadcast(request):
  
      if request.method == 'POST':
  
          form = BroadcastUploadForm(request.POST, request.FILES)
  
          if form.is_valid():
  
              upload=form.save()
  
              video_id = upload.id
  
              image_grab = ffmpeg_image.delay(video_id)
  
              video_conversion = convert_flv.delay(video_id)
  
              return HttpResponseRedirect('/current_classes/')
  
      else:
  
          form = BroadcastUploadForm(initial={'teacher': request.user,})
  
      return render_to_response('videos/create_video.html', {'form': form,}, context_instance=RequestContext(request))
  
  
  
  #settings.py
  
  DEFAULT_FILE_STORAGE = 'myapp.s3utils.MediaRootS3BotoStorage'
  
  DEFAULT_S3_PATH = "media"
  
  STATICFILES_STORAGE = 'myapp.s3utils.StaticRootS3BotoStorage'
  
  STATIC_S3_PATH = "static"
  
  AWS_STORAGE_BUCKET_NAME = 'my_bucket'
  
  CLOUDFRONT_DOMAIN = 'domain.cloudfront.net'
  
  AWS_ACCESS_KEY_ID = 'MY_KEY_ID'
  
  AWS_SECRET_ACCESS_KEY = 'MY_SECRET_KEY'
  
  MEDIA_ROOT = '/%s/' % DEFAULT_S3_PATH
  
  MEDIA_URL = 'http://%s/%s/' % (CLOUDFRONT_DOMAIN, DEFAULT_S3_PATH)
  
  ...
  
  
  
  #s3utils.py
  
  from storages.backends.s3boto import S3BotoStorage
  
  from django.utils.functional import SimpleLazyObject
  
  
  
  StaticRootS3BotoStorage = lambda: S3BotoStorage(location='static')
  
  MediaRootS3BotoStorage  = lambda: S3BotoStorage(location='media')

  I can add any other info if needed to help me solve my problem.