Recherche avancée
Autres articles (89)
-
HTML5 audio and video support
13 avril 2011, parMediaSPIP uses HTML5 video and audio tags to play multimedia files, taking advantage of the latest W3C innovations supported by modern browsers.
The MediaSPIP player used has been created specifically for MediaSPIP and can be easily adapted to fit in with a specific theme.
For older browsers the Flowplayer flash fallback is used.
MediaSPIP allows for media playback on major mobile platforms with the above (...) -
Support audio et vidéo HTML5
10 avril 2011MediaSPIP utilise les balises HTML5 video et audio pour la lecture de documents multimedia en profitant des dernières innovations du W3C supportées par les navigateurs modernes.
Pour les navigateurs plus anciens, le lecteur flash Flowplayer est utilisé.
Le lecteur HTML5 utilisé a été spécifiquement créé pour MediaSPIP : il est complètement modifiable graphiquement pour correspondre à un thème choisi.
Ces technologies permettent de distribuer vidéo et son à la fois sur des ordinateurs conventionnels (...) -
Problèmes fréquents
10 mars 2010, parPHP et safe_mode activé
Une des principales sources de problèmes relève de la configuration de PHP et notamment de l’activation du safe_mode
La solution consiterait à soit désactiver le safe_mode soit placer le script dans un répertoire accessible par apache pour le site
Sur d’autres sites (9892)
-
ErrorCode 1 while merging 2 videos
10 janvier 2023, par Stéphane de LucaI am trying to merge two videos but have an error code 1.


My command is as follows :


final command =
 '-y $commandPaths -filter_complex \'[0:0][1:0]concat=n=${paths.length}:v=1:a=0[out]\' -map \'[out]\' $outputPath';


I see the following error :




I/flutter (17343) : Stream specifier ':0' in filtergraph description [0:0][1:0]concat=n=2:v=1:a=0[out] matches no streams.




Not easy to understand what caused this as I am not familiar with the lib.


I saw in a so that someone had the issue caused by the tw videos not having the same size.


The logs are as follows :


I/flutter (17343): Duration: 2.9345
I/flutter (17343): /data/user/0/com.example.shokaze/cache/PXL_20230104_041034414.TS.mp4 exists?: true
I/flutter (17343): Duration: 3.0677
I/flutter (17343): /data/user/0/com.example.shokaze/cache/PXL_20230104_041054379.TS.mp4 exists?: true
I/flutter (17343): Output duration; 6.0022


I/flutter (17343): About to executing: -y -i /data/user/0/com.example.shokaze/cache/PXL_20230104_041034414.TS.mp4 -i /data/user/0/com.example.shokaze/cache/PXL_20230104_041054379.TS.mp4 -filter_complex '[0:0][1:0]concat=n=2:v=1:a=0[out]' -map '[out]' /data/user/0/com.example.shokaze/app_flutter/output.mp4



I/flutter (17343): ffmpeg version n5.1.2
I/flutter (17343): Copyright (c) 2000-2022 the FFmpeg developers
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): built with Android (7155654, based on r399163b1) clang version 11.0.5 (https://android.googlesource.com/toolchain/llvm-project 87f1315dfbea7c137aa2e6d362dbb457e388158d)
I/flutter (17343): 
I/flutter (17343): configuration: --cross-prefix=aarch64-linux-android- --sysroot=/files/android-sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/sysroot --prefix=/home/taner/Projects/ffmpeg-kit/prebuilt/android-arm64/ffmpeg --pkg-config=/usr/bin/pkg-config --enable-version3 --arch=aarch64 --cpu=armv8-a --target-os=android --enable-neon --enable-asm --enable-inline-asm --ar=aarch64-linux-android-ar --cc=aarch64-linux-android24-clang --cxx=aarch64-linux-android24-clang++ --ranlib=aarch64-linux-android-ranlib --strip=aarch64-linux-android-strip --nm=aarch64-linux-android-nm --extra-libs='-L/home/taner/Projects/ffmpeg-kit/prebuilt/android-arm64/cpu-features/lib -lndk_compat' --disable-autodetect --enable-cross-compile --enable-pic --enable-jni --enable-optimizations --enable-swscale --disable-static --enable-shared --enable-pthreads --enable-v4l2-m2m --disable-outdev=fbdev --disable-indev=fbdev --enable-small --disable-xmm-clobber-test --disable-debug --enable-lto --disable-neon-clobber-test --disable-programs --disab
I/flutter (17343): 
I/flutter (17343): libavutil 57. 28.100 / 57. 28.100
I/flutter (17343): 
I/flutter (17343): libavcodec 59. 37.100 / 59. 37.100
I/flutter (17343): 
I/flutter (17343): libavformat 59. 27.100 / 59. 27.100
I/flutter (17343): 
I/flutter (17343): libavdevice 59. 7.100 / 59. 7.100
I/flutter (17343): 
I/flutter (17343): libavfilter 8. 44.100 / 8. 44.100
I/flutter (17343): 
I/flutter (17343): libswscale 6. 7.100 / 6. 7.100
I/flutter (17343): 
I/flutter (17343): libswresample 4. 7.100 / 4. 7.100
I/flutter (17343): 
I/flutter (17343): Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/data/user/0/com.example.shokaze/cache/PXL_20230104_041034414.TS.mp4':
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): major_brand : 
I/flutter (17343): isom
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): minor_version : 
I/flutter (17343): 131072
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): compatible_brands: 
I/flutter (17343): isomiso2mp41
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:38.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): location : 
I/flutter (17343): +48.8638+2.4376/
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): location-eng : 
I/flutter (17343): +48.8638+2.4376/
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): com.android.capture.fps: 
I/flutter (17343): 30.000000
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Duration: 
I/flutter (17343): 00:00:02.93
I/flutter (17343): , start: 
I/flutter (17343): 0.000000
I/flutter (17343): , bitrate: 
I/flutter (17343): 19691 kb/s
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #0:0
I/flutter (17343): [0x1]
I/flutter (17343): (eng)
I/flutter (17343): : Data: none (mett / 0x7474656D), 53 kb/s
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:38.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): MetaHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #0:1
I/flutter (17343): [0x2]
I/flutter (17343): (eng)
I/flutter (17343): : Audio: aac (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 191 kb/s
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:38.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): SoundHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): vendor_id : 
I/flutter (17343): [0][0][0][0]
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #0:2
I/flutter (17343): [0x3]
I/flutter (17343): (eng)
I/flutter (17343): : Video: hevc (hvc1 / 0x31637668), yuvj420p(pc, bt709), 1920x1080, 19436 kb/s
I/flutter (17343): , SAR 1:1 DAR 16:9
I/flutter (17343): , 
I/flutter (17343): 29.99 fps, 
I/flutter (17343): 30 tbr, 
I/flutter (17343): 90k tbn
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:38.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): VideoHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): vendor_id : 
I/flutter (17343): [0][0][0][0]
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #0:3
I/flutter (17343): [0x4]
I/flutter (17343): (eng)
I/flutter (17343): : Data: none (mett / 0x7474656D)
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:38.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): MetaHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Input #1, mov,mp4,m4a,3gp,3g2,mj2, from '/data/user/0/com.example.shokaze/cache/PXL_20230104_041054379.TS.mp4':
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): major_brand : 
I/flutter (17343): isom
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): minor_version : 
I/flutter (17343): 131072
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): compatible_brands: 
I/flutter (17343): isomiso2mp41
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:58.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): location : 
I/flutter (17343): +48.8638+2.4376/
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): location-eng : 
I/flutter (17343): +48.8638+2.4376/
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): com.android.capture.fps: 
I/flutter (17343): 30.000000
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Duration: 
I/flutter (17343): 00:00:03.07
I/flutter (17343): , start: 
I/flutter (17343): 0.000000
I/flutter (17343): , bitrate: 
I/flutter (17343): 20104 kb/s
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #1:0
I/flutter (17343): [0x1]
I/flutter (17343): (eng)
I/flutter (17343): : Data: none (mett / 0x7474656D), 54 kb/s
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:58.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): MetaHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #1:1
I/flutter (17343): [0x2]
I/flutter (17343): (eng)
I/flutter (17343): : Audio: aac (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 191 kb/s
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:58.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): SoundHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): vendor_id : 
I/flutter (17343): [0][0][0][0]
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #1:2
I/flutter (17343): [0x3]
I/flutter (17343): (eng)
I/flutter (17343): : Video: hevc (hvc1 / 0x31637668), yuvj420p(pc, bt709), 1920x1080, 19848 kb/s
I/flutter (17343): , SAR 1:1 DAR 16:9
I/flutter (17343): , 
I/flutter (17343): 29.99 fps, 
I/flutter (17343): 30 tbr, 
I/flutter (17343): 90k tbn
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:58.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): VideoHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): vendor_id : 
I/flutter (17343): [0][0][0][0]
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Side data:
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): displaymatrix: rotation of -90.00 degrees
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #1:3
I/flutter (17343): [0x4]
I/flutter (17343): (eng)
I/flutter (17343): : Data: none (mett / 0x7474656D)
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:58.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): MetaHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream specifier ':0' in filtergraph description [0:0][1:0]concat=n=2:v=1:a=0[out] matches no streams.
I/flutter (17343): 
I/flutter (17343): executing: -y -i /data/user/0/com.example.shokaze/cache/PXL_20230104_041034414.TS.mp4 -i /data/user/0/com.example.shokaze/cache/PXL_20230104_041054379.TS.mp4 -filter_complex '[0:0][1:0]concat=n=2:v=1:a=0[out]' -map '[out]' /data/user/0/com.example.shokaze/app_flutter/output.mp4
I/flutter (17343): error 1


Therefore I tried to add a resize in the command without success as follows :.


final command =
 '$commandPaths -filter_complex \'[0:v]scale=1920:1080[0:a] [1:v]scale=1920:1080[1:a] concat=n=${paths.length}:v=1:a=1[v][a]\' -map \'[v]\' -map \'[a]\' $outputPath';



This time the logs say :




I/flutter (17343) : [AVFilterGraph @ 0xb4000074ea6265f0] No output pad can be associated to link label '1:v'.




The logs are as follows :


I/flutter (17343): Duration: 2.9345
I/flutter (17343): /data/user/0/com.example.shokaze/cache/PXL_20230104_041034414.TS.mp4 exists?: true
I/flutter (17343): Duration: 3.0677
I/flutter (17343): /data/user/0/com.example.shokaze/cache/PXL_20230104_041054379.TS.mp4 exists?: true
I/flutter (17343): Output duration; 6.0022
I/flutter (17343): About to executing: -i /data/user/0/com.example.shokaze/cache/PXL_20230104_041034414.TS.mp4 -i /data/user/0/com.example.shokaze/cache/PXL_20230104_041054379.TS.mp4 -filter_complex '[0:v]scale=1920:1080[0:a] [1:v]scale=1920:1080[1:a] concat=n=2:v=1:a=1[v][a]' -map '[v]' -map '[a]' /data/user/0/com.example.shokaze/app_flutter/output.mp4
I/flutter (17343): ffmpeg version n5.1.2
I/flutter (17343): Copyright (c) 2000-2022 the FFmpeg developers
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): built with Android (7155654, based on r399163b1) clang version 11.0.5 (https://android.googlesource.com/toolchain/llvm-project 87f1315dfbea7c137aa2e6d362dbb457e388158d)
I/flutter (17343): 
I/flutter (17343): configuration: --cross-prefix=aarch64-linux-android- --sysroot=/files/android-sdk/ndk/22.1.7171670/toolchains/llvm/prebuilt/linux-x86_64/sysroot --prefix=/home/taner/Projects/ffmpeg-kit/prebuilt/android-arm64/ffmpeg --pkg-config=/usr/bin/pkg-config --enable-version3 --arch=aarch64 --cpu=armv8-a --target-os=android --enable-neon --enable-asm --enable-inline-asm --ar=aarch64-linux-android-ar --cc=aarch64-linux-android24-clang --cxx=aarch64-linux-android24-clang++ --ranlib=aarch64-linux-android-ranlib --strip=aarch64-linux-android-strip --nm=aarch64-linux-android-nm --extra-libs='-L/home/taner/Projects/ffmpeg-kit/prebuilt/android-arm64/cpu-features/lib -lndk_compat' --disable-autodetect --enable-cross-compile --enable-pic --enable-jni --enable-optimizations --enable-swscale --disable-static --enable-shared --enable-pthreads --enable-v4l2-m2m --disable-outdev=fbdev --disable-indev=fbdev --enable-small --disable-xmm-clobber-test --disable-debug --enable-lto --disable-neon-clobber-test --disable-programs --disab
I/flutter (17343): 
I/flutter (17343): libavutil 57. 28.100 / 57. 28.100
I/flutter (17343): 
I/flutter (17343): libavcodec 59. 37.100 / 59. 37.100
I/flutter (17343): 
I/flutter (17343): libavformat 59. 27.100 / 59. 27.100
I/flutter (17343): 
I/flutter (17343): libavdevice 59. 7.100 / 59. 7.100
I/flutter (17343): 
I/flutter (17343): libavfilter 8. 44.100 / 8. 44.100
I/flutter (17343): 
I/flutter (17343): libswscale 6. 7.100 / 6. 7.100
I/flutter (17343): 
I/flutter (17343): libswresample 4. 7.100 / 4. 7.100
I/flutter (17343): 
I/flutter (17343): Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/data/user/0/com.example.shokaze/cache/PXL_20230104_041034414.TS.mp4':
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): major_brand : 
I/flutter (17343): isom
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): minor_version : 
I/flutter (17343): 131072
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): compatible_brands: 
I/flutter (17343): isomiso2mp41
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:38.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): location : 
I/flutter (17343): +48.8638+2.4376/
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): location-eng : 
I/flutter (17343): +48.8638+2.4376/
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): com.android.capture.fps: 
I/flutter (17343): 30.000000
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Duration: 
I/flutter (17343): 00:00:02.93
I/flutter (17343): , start: 
I/flutter (17343): 0.000000
I/flutter (17343): , bitrate: 
I/flutter (17343): 19691 kb/s
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #0:0
I/flutter (17343): [0x1]
I/flutter (17343): (eng)
I/flutter (17343): : Data: none (mett / 0x7474656D), 53 kb/s
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:38.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): MetaHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #0:1
I/flutter (17343): [0x2]
I/flutter (17343): (eng)
I/flutter (17343): : Audio: aac (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 191 kb/s
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:38.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): SoundHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): vendor_id : 
I/flutter (17343): [0][0][0][0]
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #0:2
I/flutter (17343): [0x3]
I/flutter (17343): (eng)
I/flutter (17343): : Video: hevc (hvc1 / 0x31637668), yuvj420p(pc, bt709), 1920x1080, 19436 kb/s
I/flutter (17343): , SAR 1:1 DAR 16:9
I/flutter (17343): , 
I/flutter (17343): 29.99 fps, 
I/flutter (17343): 30 tbr, 
I/flutter (17343): 90k tbn
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:38.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): VideoHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): vendor_id : 
I/flutter (17343): [0][0][0][0]
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #0:3
I/flutter (17343): [0x4]
I/flutter (17343): (eng)
I/flutter (17343): : Data: none (mett / 0x7474656D)
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:38.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): MetaHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Input #1, mov,mp4,m4a,3gp,3g2,mj2, from '/data/user/0/com.example.shokaze/cache/PXL_20230104_041054379.TS.mp4':
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): major_brand : 
I/flutter (17343): isom
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): minor_version : 
I/flutter (17343): 131072
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): compatible_brands: 
I/flutter (17343): isomiso2mp41
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:58.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): location : 
I/flutter (17343): +48.8638+2.4376/
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): location-eng : 
I/flutter (17343): +48.8638+2.4376/
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): com.android.capture.fps: 
I/flutter (17343): 30.000000
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Duration: 
I/flutter (17343): 00:00:03.07
I/flutter (17343): , start: 
I/flutter (17343): 0.000000
I/flutter (17343): , bitrate: 
I/flutter (17343): 20104 kb/s
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #1:0
I/flutter (17343): [0x1]
I/flutter (17343): (eng)
I/flutter (17343): : Data: none (mett / 0x7474656D), 54 kb/s
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:58.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): MetaHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #1:1
I/flutter (17343): [0x2]
I/flutter (17343): (eng)
I/flutter (17343): : Audio: aac (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 191 kb/s
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:58.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): SoundHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): vendor_id : 
I/flutter (17343): [0][0][0][0]
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #1:2
I/flutter (17343): [0x3]
I/flutter (17343): (eng)
I/flutter (17343): : Video: hevc (hvc1 / 0x31637668), yuvj420p(pc, bt709), 1920x1080, 19848 kb/s
I/flutter (17343): , SAR 1:1 DAR 16:9
I/flutter (17343): , 
I/flutter (17343): 29.99 fps, 
I/flutter (17343): 30 tbr, 
I/flutter (17343): 90k tbn
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:58.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): VideoHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): vendor_id : 
I/flutter (17343): [0][0][0][0]
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Side data:
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): displaymatrix: rotation of -90.00 degrees
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Stream #1:3
I/flutter (17343): [0x4]
I/flutter (17343): (eng)
I/flutter (17343): : Data: none (mett / 0x7474656D)
I/flutter (17343): (default)
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): Metadata:
I/flutter (17343): 
I/flutter (17343): creation_time : 
I/flutter (17343): 2023-01-04T04:10:58.000000Z
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): handler_name : 
I/flutter (17343): MetaHandle
I/flutter (17343): 
I/flutter (17343): 
I/flutter (17343): [AVFilterGraph @ 0xb4000074ea6265f0] No output pad can be associated to link label '1:v'.
I/flutter (17343): 
I/flutter (17343): Error initializing complex filters.
I/flutter (17343): 
I/flutter (17343): Invalid argument
I/flutter (17343): 
I/flutter (17343): Conversion failed!
I/flutter (17343): 
I/flutter (17343): executing: -i /data/user/0/com.example.shokaze/cache/PXL_20230104_041034414.TS.mp4 -i /data/user/0/com.example.shokaze/cache/PXL_20230104_041054379.TS.mp4 -filter_complex '[0:v]scale=1920:1080[0:a] [1:v]scale=1920:1080[1:a] concat=n=2:v=1:a=1[v][a]' -map '[v]' -map '[a]' /data/user/0/com.example.shokaze/app_flutter/output.mp4
I/flutter (17343): error 1


-
Node.js readable maximize throughput/performance for compute intense readable - Writable doesn't pull data fast enough
31 décembre 2022, par flohallGeneral setup


I developed an application using AWS Lambda node.js 14.
I use a custom
ReadableimplementationFrameCreationStreamthat uses node-canvas to draw images, svgs and more on a canvas. This result is then extracted as a raw image buffer in BGRA. A single image buffer contains 1920 * 1080 * 4 Bytes = 8294400 Bytes 8 MB.
This is then piped tostdinof achild_processrunningffmpeg.
ThehighWaterMarkof myReadableinobjectMode:trueis set to 25 so that the internal buffer can use up to 8 MB * 25 = 200 MB.

All this works fine and also doesn't contain too much RAM. But I noticed after some time, that the performance is not ideally.


Performance not optimal


I have an example input that generates a video of 315 frames. If I set
highWaterMarkto a value above 25 the performance increases to the point, when I set to a value of 315 or above.

For some reason
ffmpegdoesn't start to pull any data untilhighWaterMarkis reached. Obviously thats not what I want.ffmpegshould always consume data if minimum 1 frame is cached in theReadableand if it has finished processing the frame before. And theReadableshould produce more frames as longhighWaterMarkisn't reached or the last frame has been reached. So ideally theReadableand theWriteableare busy all the time.

I found another way to improve the speed. If I add a timeout in the
_read()method of theReadableafter let's say every tenth frame for 100 ms. Then theffmpeg-Writablewill use this timeout to write some frames toffmpeg.

It seems like frames aren't passed to
ffmpegduring frame creation because some node.js main thread is busy ?

The fastest result I have if I increase
highWaterMarkabove the amount of frames - which doesn't work for longer videos as this would make the AWS Lambda RAM explode. And this makes the whole streaming idea useless. Using timeouts always gives me stomach pain. Also depending on the execution on different environments a good fitting timeout might differ. Any ideas ?

FrameCreationStream


import canvas from 'canvas';
import {Readable} from 'stream';
import {IMAGE_STREAM_BUFFER_SIZE, PerformanceUtil, RenderingLibraryError, VideoRendererInput} from 'vm-rendering-backend-commons';
import {AnimationAssets, BufferType, DrawingService, FullAnimationData} from 'vm-rendering-library';

/**
 * This is a proper back pressure compatible implementation of readable for a having a stream to read single frames from.
 * Whenever read() is called a new frame is created and added to the stream.
 * read() will be called internally until options.highWaterMark has been reached.
 * then calling read will be paused until one frame is read from the stream.
 */
export class FrameCreationStream extends Readable {

 drawingService: DrawingService;
 endFrameIndex: number;
 currentFrameIndex: number = 0;
 startFrameIndex: number;
 frameTimer: [number, number];
 readTimer: [number, number];
 fullAnimationData: FullAnimationData;

 constructor(animationAssets: AnimationAssets, fullAnimationData: FullAnimationData, videoRenderingInput: VideoRendererInput, frameTimer: [number, number]) {
 super({highWaterMark: IMAGE_STREAM_BUFFER_SIZE, objectMode: true});

 this.frameTimer = frameTimer;
 this.readTimer = PerformanceUtil.startTimer();

 this.fullAnimationData = fullAnimationData;

 this.startFrameIndex = Math.floor(videoRenderingInput.startFrameId);
 this.currentFrameIndex = this.startFrameIndex;
 this.endFrameIndex = Math.floor(videoRenderingInput.endFrameId);

 this.drawingService = new DrawingService(animationAssets, fullAnimationData, videoRenderingInput, canvas);
 console.time("read");
 }

 /**
 * this method is only overwritten for debugging
 * @param size
 */
 read(size?: number): string | Buffer {

 console.log("read("+size+")");
 const buffer = super.read(size);
 console.log(buffer);
 console.log(buffer?.length);
 if(buffer) {
 console.timeLog("read");
 }
 return buffer;
 }

 // _read() will be called when the stream wants to pull more data in.
 // _read() will be called again after each call to this.push(dataChunk) once the stream is ready to accept more data. https://nodejs.org/api/stream.html#readable_readsize
 // this way it is ensured, that even though this.createImageBuffer() is async, only one frame is created at a time and the order is kept
 _read(): void {
 // as frame numbers are consecutive and unique, we have to draw each frame number (also the first and the last one)
 if (this.currentFrameIndex <= this.endFrameIndex) {
 PerformanceUtil.logTimer(this.readTimer, 'WAIT -> READ\t');
 this.createImageBuffer()
 .then(buffer => this.optionalTimeout(buffer))
 // push means adding a buffered raw frame to the stream
 .then((buffer: Buffer) => {
 this.readTimer = PerformanceUtil.startTimer();
 // the following two frame numbers start with 1 as first value
 const processedFrameNumberOfScene = 1 + this.currentFrameIndex - this.startFrameIndex;
 const totalFrameNumberOfScene = 1 + this.endFrameIndex - this.startFrameIndex;
 // the overall frameId or frameIndex starts with frameId 0
 const processedFrameIndex = this.currentFrameIndex;
 this.currentFrameIndex++;
 this.push(buffer); // nothing besides logging should happen after calling this.push(buffer)
 console.log(processedFrameNumberOfScene + ' of ' + totalFrameNumberOfScene + ' processed - full video frameId: ' + processedFrameIndex + ' - buffered frames: ' + this.readableLength);
 })
 .catch(err => {
 // errors will be finally handled, when subscribing to frameCreation stream in ffmpeg service
 // this log is just generated for tracing errors and if for some reason the handling in ffmpeg service doesn't work
 console.log("createImageBuffer: ", err);
 this.emit("error", err);
 });
 } else {
 // push(null) makes clear that this stream has ended
 this.push(null);
 PerformanceUtil.logTimer(this.frameTimer, 'FRAME_STREAM');
 }
 }

 private optionalTimeout(buffer: Buffer): Promise<buffer> {
 if(this.currentFrameIndex % 10 === 0) {
 return new Promise(resolve => setTimeout(() => resolve(buffer), 140));
 }
 return Promise.resolve(buffer);
 }

 // prevent memory leaks - without this lambda memory will increase with every call
 _destroy(): void {
 this.drawingService.destroyStage();
 }

 /**
 * This creates a raw pixel buffer that contains a single frame of the video drawn by the rendering library
 *
 */
 public async createImageBuffer(): Promise<buffer> {

 const drawTimer = PerformanceUtil.startTimer();
 try {
 await this.drawingService.drawForFrame(this.currentFrameIndex);
 } catch (err: any) {
 throw new RenderingLibraryError(err);
 }

 PerformanceUtil.logTimer(drawTimer, 'DRAW -> FRAME\t');

 const bufferTimer = PerformanceUtil.startTimer();
 // Creates a raw pixel buffer, containing simple binary data
 // the exact same information (BGRA/screen ratio) has to be provided to ffmpeg, because ffmpeg cannot detect format for raw input
 const buffer = await this.drawingService.toBuffer(BufferType.RAW);
 PerformanceUtil.logTimer(bufferTimer, 'CANVAS -> BUFFER');

 return buffer;
 }
}
</buffer></buffer>

FfmpegService


import {ChildProcess, execFile} from 'child_process';
import {Readable} from 'stream';
import {FPS, StageSize} from 'vm-rendering-library';
import {
 FfmpegError,
 LOCAL_MERGE_VIDEOS_TEXT_FILE, LOCAL_SOUND_FILE_PATH,
 LOCAL_VIDEO_FILE_PATH,
 LOCAL_VIDEO_SOUNDLESS_MERGE_FILE_PATH
} from "vm-rendering-backend-commons";

/**
 * This class bundles all ffmpeg usages for rendering one scene.
 * FFmpeg is a console program which can transcode nearly all types of sounds, images and videos from one to another.
 */
export class FfmpegService {

 ffmpegPath: string = null;


 constructor(ffmpegPath: string) {
 this.ffmpegPath = ffmpegPath;
 }

 /**
 * Convert a stream of raw images into an .mp4 video using the command line program ffmpeg.
 *
 * @param inputStream an input stream containing images in raw format BGRA
 * @param stageSize the size of a single frame in pixels (minimum is 2*2)
 * @param outputPath the filepath to write the resulting video to
 */
 public imageToVideo(inputStream: Readable, stageSize: StageSize, outputPath: string): Promise<void> {
 const args: string[] = [
 '-f',
 'rawvideo',
 '-r',
 `${FPS}`,
 '-pix_fmt',
 'bgra',
 '-s',
 `${stageSize.width}x${stageSize.height}`,
 '-i',
 // input "-" means input will be passed via pipe (streamed)
 '-',
 // codec that also QuickTime player can understand
 '-vcodec',
 'libx264',
 '-pix_fmt',
 'yuv420p',
 /*
 * "-movflags faststart":
 * metadata at beginning of file
 * needs more RAM
 * file will be broken, if not finished properly
 * higher application compatibility
 * better for browser streaming
 */
 '-movflags',
 'faststart',
 // "-preset ultrafast", //use this to speed up compression, but quality/compression ratio gets worse
 // don't overwrite an existing file here,
 // but delete file in the beginning of execution index.ts
 // (this is better for local testing believe me)
 outputPath
 ];

 return this.execFfmpegPromise(args, inputStream);
 }

 private execFfmpegPromise(args: string[], inputStream?: Readable): Promise<void> {
 const ffmpegServiceSelf = this;
 return new Promise(function (resolve, reject) {
 const executionProcess: ChildProcess = execFile(ffmpegServiceSelf.ffmpegPath, args, (err) => {
 if (err) {
 reject(new FfmpegError(err));
 } else {
 console.log('ffmpeg finished');
 resolve();
 }
 });
 if (inputStream) {
 // it's important to listen on errors of input stream before piping it into the write stream
 // if we don't do this here, we get an unhandled promise exception for every issue in the input stream
 inputStream.on("error", err => {
 reject(err);
 });
 // don't reject promise here as the error will also be thrown inside execFile and will contain more debugging info
 // this log is just generated for tracing errors and if for some reason the handling in execFile doesn't work
 inputStream.pipe(executionProcess.stdin).on("error", err => console.log("pipe stream: " , err));
 }
 });
 }
}
</void></void>

-
What should be the timing to capture screenshots as images and then convert the images to video file using ffmpeg ?
22 juillet 2016, par TheLost LostitI have a timer tick event where i take screenshots every 10ms
int count = 0;
private void timer1_Tick(object sender, EventArgs e)
{
Bitmap bmp = new Bitmap(sc.CaptureScreen());
bmp.Save(@"D:\SavedScreenshots\screenshot" + count + ".bmp", System.Drawing.Imaging.ImageFormat.Bmp);
bmp.Dispose();
count ++;
}Then i i’m using ffmpeg command line in command prompt window to create a video file from all the images :
ffmpeg -framerate 2 -i screenshot%d.bmp -c:v libx264 -r 30 -pix_fmt yuv420p out.mp4Every bitmap file on hard disk it’s size is 7.91 MB
The details : 1920x 1080 and Bit depth 32The problem is when making the ffmpeg command line with -framerate 2 then when i play the video file in windows media player it’s very very slow.
When i saet the framerate to 10 then it’s too fast.
When i set the framerate to 4 i’m getting error in yellow say too large.But maybe the problem is that i’m taking a screenshot every 10ms ? Maybe i should take a screenshot every 1000ms ? And then what should i change in the ffmpeg command line ?
I want it to be like a regular video file speed. Not too fast and not too slow.
What i’m capturing in the screenshot is my desktop screen and later i want to upload and show it to some support help in a forum.
Syndiquer tout le site
