Recherche avancée

Sur d’autres sites (4635)

• OpenCV VideoWriter using ffmpeg with "Could not open codec 'libx264'" Error

  28 septembre 2016, par user2262504

  I am new to OpenCV, and I want write Mat images into video using VideoWriter on Ubuntu 12.04. But when constructing VideoWriter, errors came out.

  It seems that OpenCV invoke ffmpeg API using default parameters and ffmpeg invoke x264 using its default parameters. Then these setting is broken for libx264. Thus the "Could not open codec ’libx264’" error.

  Anyone has ideas to solve this problem ?

  More specifically :

  1. anyone knows where and how OpenCV invoke ffmpeg API ?
  2. how to change ffmpeg default settings using code, hopefull, can be easily embeded into OpenCV ?
  3. will changes of default in ffmpeg be carried to libx264 ?

  Errors :

  1. Uising CV_FOURCC('H', '2', '6', '4')
  
  [libx264 @ 0x255de40] broken ffmpeg default settings detected
  
  [libx264 @ 0x255de40] use an encoding preset (e.g. -vpre medium)
  
  [libx264 @ 0x255de40] preset usage: -vpre <speed> -vpre <profile>
  
  [libx264 @ 0x255de40] speed presets are listed in x264 --help
  
  [libx264 @ 0x255de40] profile is optional; x264 defaults to high
  
  Could not open codec 'libx264': Unspecified error
  
  
  
  2. Using FOURCC = -1 to invoke user customized codec
  
  OpenCV Error: Unsupported format or combination of formats (Gstreamer Opencv 
  
  backend doesn't support this codec acutally.) in CvVideoWriter_GStreamer::open, 
  
  file /home/XXX/Downloads/opencv-2.4.8/modules/highgui/src/cap_gstreamer.cpp, 
  
  line 505 terminate called after throwing an instance of 'cv::Exception'
  
  what():  /home/XXX/Downloads/opencv-2.4.8/modules/highgui/src/cap_gstreamer.cpp:
  
  505: error: (-210) Gstreamer Opencv backend doesn't support this codec acutally.
  
  in function CvVideoWriter_GStreamer::open
  
  </profile></speed>

  Codes :

  int main(int argc, char *argv[])
  
  {
  
      VideoWriter outputVideo;
  
      bool fourcc_on = true; //switch on / off different error
  
      if (fourcc_on)
  
          outputVideo.open("outVideo.avi", CV_FOURCC('H', '2', '6', '4'), 25, Size(100, 100), true);
  
      else
  
          outputVideo.open("outVideo.avi", -1, 25, Size(100, 100), true);
  
  
  
      if (!outputVideo.isOpened())
  
      {
  
          cout  << "Could not open the output video for write" << endl;
  
          return -1;
  
      }
  
      return 0;
  
  }

  OpenCV Configuration :

  -- Detected version of GNU GCC: 46 (406)
  
  -- Found OpenEXR: /usr/lib/libIlmImf.so
  
  -- Looking for linux/videodev.h
  
  -- Looking for linux/videodev.h - not found
  
  -- Looking for linux/videodev2.h
  
  -- Looking for linux/videodev2.h - found
  
  -- Looking for sys/videoio.h
  
  -- Looking for sys/videoio.h - not found
  
  -- Looking for libavformat/avformat.h
  
  -- Looking for libavformat/avformat.h - found
  
  -- Looking for ffmpeg/avformat.h
  
  -- Looking for ffmpeg/avformat.h - not found
  
  -- Could NOT find JNI (missing:  JAVA_INCLUDE_PATH JAVA_INCLUDE_PATH2 JAVA_AWT_INCLUDE_PATH) 
  
  -- 
  
  -- General configuration for OpenCV 2.4.8 =====================================
  
  --   Version control:               unknown
  
  -- 
  
  --   Platform:
  
  --     Host:                        Linux 3.8.0-38-generic x86_64
  
  --     CMake:                       2.8.7
  
  --     CMake generator:             Unix Makefiles
  
  --     CMake build tool:            /usr/bin/make
  
  --     Configuration:               RELEASE
  
  -- 
  
  --   C/C++:
  
  --     Built as dynamic libs?:      YES
  
  --     C++ Compiler:                /usr/bin/c++  (ver 4.6)
  
  --     C++ flags (Release):         -fsigned-char -W -Wall -Werror=return-type -Werror=address -Werror=sequence-point -Wformat -Werror=format-security -Wmissing-declarations -Wundef -Winit-self -Wpointer-arith -Wshadow -Wsign-promo -fdiagnostics-show-option -Wno-long-long -pthread -fomit-frame-pointer -msse -msse2 -msse3 -ffunction-sections -O3 -DNDEBUG  -DNDEBUG
  
  --     C++ flags (Debug):           -fsigned-char -W -Wall -Werror=return-type -Werror=address -Werror=sequence-point -Wformat -Werror=format-security -Wmissing-declarations -Wundef -Winit-self -Wpointer-arith -Wshadow -Wsign-promo -fdiagnostics-show-option -Wno-long-long -pthread -fomit-frame-pointer -msse -msse2 -msse3 -ffunction-sections -g  -O0 -DDEBUG -D_DEBUG
  
  --     C Compiler:                  /usr/bin/gcc
  
  --     C flags (Release):           -fsigned-char -W -Wall -Werror=return-type -Werror=address -Werror=sequence-point -Wformat -Werror=format-security -Wmissing-declarations -Wmissing-prototypes -Wstrict-prototypes -Wundef -Winit-self -Wpointer-arith -Wshadow -fdiagnostics-show-option -Wno-long-long -pthread -fomit-frame-pointer -msse -msse2 -msse3 -ffunction-sections -O3 -DNDEBUG  -DNDEBUG
  
  --     C flags (Debug):             -fsigned-char -W -Wall -Werror=return-type -Werror=address -Werror=sequence-point -Wformat -Werror=format-security -Wmissing-declarations -Wmissing-prototypes -Wstrict-prototypes -Wundef -Winit-self -Wpointer-arith -Wshadow -fdiagnostics-show-option -Wno-long-long -pthread -fomit-frame-pointer -msse -msse2 -msse3 -ffunction-sections -g  -O0 -DDEBUG -D_DEBUG
  
  --     Linker flags (Release):      
  
  --     Linker flags (Debug):        
  
  --     Precompiled headers:         YES
  
  -- 
  
  --   OpenCV modules:
  
  --     To be built:                 core flann imgproc highgui features2d calib3d ml video legacy objdetect photo gpu ocl nonfree contrib python stitching superres ts videostab
  
  --     Disabled:                    world
  
  --     Disabled by dependency:      -
  
  --     Unavailable:                 androidcamera dynamicuda java
  
  -- 
  
  --   GUI: 
  
  --     QT:                          NO
  
  --     GTK+ 2.x:                    YES (ver 2.24.10)
  
  --     GThread :                    YES (ver 2.32.4)
  
  --     GtkGlExt:                    NO
  
  --     OpenGL support:              NO
  
  -- 
  
  --   Media I/O: 
  
  --     ZLib:                        /usr/lib/x86_64-linux-gnu/libz.so (ver 1.2.3.4)
  
  --     JPEG:                        /usr/lib/x86_64-linux-gnu/libjpeg.so (ver )
  
  --     PNG:                         /usr/lib/x86_64-linux-gnu/libpng.so (ver 1.2.46)
  
  --     TIFF:                        /usr/lib/x86_64-linux-gnu/libtiff.so (ver 42 - 3.9.5)
  
  --     JPEG 2000:                   /usr/lib/x86_64-linux-gnu/libjasper.so (ver 1.900.1)
  
  --     OpenEXR:                     /usr/lib/libImath.so /usr/lib/libIlmImf.so /usr/lib/libIex.so /usr/lib/libHalf.so /usr/lib/libIlmThread.so (ver 1.6.1)
  
  -- 
  
  --   Video I/O:
  
  --     DC1394 1.x:                  NO
  
  --     DC1394 2.x:                  YES (ver 2.2.0)
  
  --     FFMPEG:                      YES
  
  --       codec:                     YES (ver 55.58.105)
  
  --       format:                    YES (ver 55.37.101)
  
  --       util:                      YES (ver 52.78.100)
  
  --       swscale:                   YES (ver 2.6.100)
  
  --       gentoo-style:              YES
  
  --     GStreamer:                   
  
  --       base:                      YES (ver 0.10.36)
  
  --       app:                       YES (ver 0.10.36)
  
  --       video:                     YES (ver 0.10.36)
  
  --     OpenNI:                      NO
  
  --     OpenNI PrimeSensor Modules:  NO
  
  --     PvAPI:                       NO
  
  --     GigEVisionSDK:               NO
  
  --     UniCap:                      NO
  
  --     UniCap ucil:                 NO
  
  --     V4L/V4L2:                    Using libv4l (ver 1.0.1)
  
  --     XIMEA:                       NO
  
  --     Xine:                        NO
  
  -- 
  
  --   Other third-party libraries:
  
  --     Use IPP:                     NO
  
  --     Use Eigen:                   NO
  
  --     Use TBB:                     NO
  
  --     Use OpenMP:                  NO
  
  --     Use GCD                      NO
  
  --     Use Concurrency              NO
  
  --     Use C=:                      NO
  
  --     Use Cuda:                    NO
  
  --     Use OpenCL:                  YES
  
  -- 
  
  --   OpenCL:
  
  --     Version:                     dynamic
  
  --     Include path:                /home/shixudongleo/Downloads/opencv-2.4.8/3rdparty/include/opencl/1.2
  
  --     Use AMD FFT:                 NO
  
  --     Use AMD BLAS:                NO
  
  -- 
  
  --   Python:
  
  --     Interpreter:                 /usr/bin/python (ver 2.7.3)
  
  --     Libraries:                   /usr/lib/libpython2.7.so
  
  --     numpy:                       /usr/lib/python2.7/dist-packages/numpy/core/include (ver 1.6.1)
  
  --     packages path:               lib/python2.7/dist-packages
  
  -- 
  
  --   Java:
  
  --     ant:                         NO
  
  --     JNI:                         NO
  
  --     Java tests:                  NO
  
  -- 
  
  --   Documentation:
  
  --     Build Documentation:         NO
  
  --     Sphinx:                      NO
  
  --     PdfLaTeX compiler:           /usr/bin/pdflatex
  
  -- 
  
  --   Tests and samples:
  
  --     Tests:                       YES
  
  --     Performance tests:           YES
  
  --     C/C++ Examples:              NO
  
  -- 
  
  --   Install path:                  /usr/local
  
  -- 
  
  --   cvconfig.h is in:              /home/shixudongleo/Downloads/opencv-2.4.8/build
  
  -- -----------------------------------------------------------------
  
  -- 
  
  -- Configuring done
  
  -- Generating done
  
  -- Build files have been written to: /home/XXX/Downloads/opencv-2.4.8/build

  FFMPEG

  ffmpeg is enable to support OpenCV and libx264 is enabled when compiling ffmpeg.
  By using ffmpeg command line, libx264 is running normally.

  $ ffmpeg -i test.avi -vcodec libx264 test.mp4
  
  ffmpeg -i test.avi -vcodec libx264 test.mp4 > ~/Downloads/ffmpeg_log.txt
  
  ffmpeg version 2.2.git Copyright (c) 2000-2014 the FFmpeg developers
  
    built on Apr 24 2014 16:39:51 with gcc 4.6 (Ubuntu/Linaro 4.6.3-1ubuntu5)
  
    configuration: --enable-gpl --enable-libfaac --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libtheora --enable-libvorbis --enable-libx264 --enable-libxvid --enable-nonfree --enable-postproc --enable-version3 --enable-x11grab --enable-shared --enable-pic
  
    libavutil      52. 78.100 / 52. 78.100
  
    libavcodec     55. 58.105 / 55. 58.105
  
    libavformat    55. 37.101 / 55. 37.101
  
    libavdevice    55. 13.100 / 55. 13.100
  
    libavfilter     4.  4.100 /  4.  4.100
  
    libswscale      2.  6.100 /  2.  6.100
  
    libswresample   0. 18.100 /  0. 18.100
  
    libpostproc    52.  3.100 / 52.  3.100
  
  Input #0, avi, from 'test.avi':
  
    Duration: 00:00:03.73, start: 0.000000, bitrate: 1757 kb/s
  
      Stream #0:0: Video: msvideo1 (CRAM / 0x4D415243), rgb555le, 320x240, 1781 kb/s, 15 tbr, 15 tbn, 15 tbc
  
      Metadata:
  
        title           : julius.avi Video #1
  
  File 'test.mp4' already exists. Overwrite ? [y/N] y
  
  No pixel format specified, yuv444p for H.264 encoding chosen.
  
  Use -pix_fmt yuv420p for compatibility with outdated media players.
  
  [libx264 @ 0x25d08e0] using cpu capabilities: none!
  
  [libx264 @ 0x25d08e0] profile High 4:4:4 Predictive, level 1.2, 4:4:4 8-bit
  
  [libx264 @ 0x25d08e0] 264 - core 142 - H.264/MPEG-4 AVC codec - Copyleft 2003-2014 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=4 threads=12 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=15 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, mp4, to 'test.mp4':
  
    Metadata:
  
      encoder         : Lavf55.37.101
  
      Stream #0:0: Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv444p, 320x240, q=-1--1, 15360 tbn, 15 tbc
  
      Metadata:
  
        title           : julius.avi Video #1
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (msvideo1 -> libx264)
  
  Press [q] to stop, [?] for help
  
  frame=   56 fps=0.0 q=-1.0 Lsize=     321kB time=00:00:03.60 bitrate= 731.0kbits/s    
  
  video:320kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.409949%
  
  [libx264 @ 0x25d08e0] frame I:3     Avg QP:15.36  size:  7975
  
  [libx264 @ 0x25d08e0] frame P:38    Avg QP:26.05  size:  6230
  
  [libx264 @ 0x25d08e0] frame B:15    Avg QP:28.25  size:  4418
  
  [libx264 @ 0x25d08e0] consecutive B-frames: 46.4% 53.6%  0.0%  0.0%
  
  [libx264 @ 0x25d08e0] mb I  I16..4:  1.4% 72.8% 25.8%
  
  [libx264 @ 0x25d08e0] mb P  I16..4:  1.6%  5.7% 15.1%  P16..4:  7.6%  6.3%  7.4%  0.0%  0.0%    skip:56.3%
  
  [libx264 @ 0x25d08e0] mb B  I16..4:  0.2%  1.0%  2.0%  B16..8: 13.3%  7.8%  8.7%  direct: 8.3%  skip:58.8%  L0:34.9% L1:36.6% BI:28.5%
  
  [libx264 @ 0x25d08e0] 8x8 transform intra:37.7% inter:2.3%
  
  [libx264 @ 0x25d08e0] coded y,u,v intra: 52.1% 42.1% 30.1% inter: 19.6% 9.2% 5.2%
  
  [libx264 @ 0x25d08e0] i16 v,h,dc,p: 56% 17% 24%  2%
  
  [libx264 @ 0x25d08e0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 10% 16% 68%  1%  1%  1%  1%  1%  1%
  
  [libx264 @ 0x25d08e0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 19% 18% 28%  5%  6%  5%  7%  5%  6%
  
  [libx264 @ 0x25d08e0] Weighted P-Frames: Y:31.6% UV:21.1%
  
  [libx264 @ 0x25d08e0] ref P L0: 70.5%  9.0% 12.1%  6.5%  2.0%
  
  [libx264 @ 0x25d08e0] ref B L0: 91.3%  8.7%
  
  [libx264 @ 0x25d08e0] kb/s:700.56

• getting errors from FFMpeg when spawned from .NET

  18 mars 2014, par Brannon

  When I run FFMpeg from the command line like this

  ffmpeg.exe -hwaccel auto -re -i "C:\Users\Public\Videos\Sample Videos\Wildlife.wmv" -an -sn -c:v bmp -pix_fmt bgr24 -f rawvideo - > junk.bin

  it works fine. However, when I spawn the exact same thing (minus > junk.bin) I get this nasty "bad header" error after a few seconds of playback. What is causing this ? I have trouble believing my process blocks the pipe longer than the filesystem does, but it should be able to block the pipe indefinitely without defeating the decoding. The truncated stderr is below. My code to spawn the thing is here.

  ffmpeg version N-60761-g916a792 Copyright (c) 2000-2014 the FFmpeg developers
  
    built on Feb 19 2014 21:57:22 with gcc 4.8.2 (GCC)
  
    configuration: --target-os=mingw32 --enable-shared --enable-runtime-cpudetect
  
    libavutil      52. 65.100 / 52. 65.100
  
    libavcodec     55. 52.102 / 55. 52.102
  
    libavformat    55. 33.100 / 55. 33.100
  
    libavdevice    55. 10.100 / 55. 10.100
  
    libavfilter     4.  1.103 /  4.  1.103
  
    libswscale      2.  5.101 /  2.  5.101
  
    libswresample   0. 17.104 /  0. 17.104
  
  cygwin warning:
  
    MS-DOS style path detected: C:\Users\Public\Videos\Sample Videos\Wildlife.wmv
  
    Preferred POSIX equivalent is: /cygdrive/c/Users/Public/Videos/Sample Videos/Wildlife.wmv
  
    CYGWIN environment variable option "nodosfilewarning" turns off this warning.
  
    Consult the user's guide for more details about POSIX paths:
  
      http://cygwin.com/cygwin-ug-net/using.html#using-pathnames
  
  [asf @ 0x600059480] Stream #0: not enough frames to estimate rate; consider increasing probesize
  
  Guessed Channel Layout for  Input Stream #0.0 : stereo
  
  Input #0, asf, from 'C:\Users\Public\Videos\Sample Videos\Wildlife.wmv':
  
    Metadata:
  
      SfOriginalFPS   : 299700
  
      WMFSDKVersion   : 11.0.6001.7000
  
      WMFSDKNeeded    : 0.0.0.0000
  
      comment         : Footage: Small World Productions, Inc; Tourism New Zealand | Producer: Gary F. Spradling | Music: Steve Ball
  
      title           : Wildlife in HD
  
      copyright       : © 2008 Microsoft Corporation
  
      IsVBR           : 0
  
      DeviceConformanceTemplate: AP@L3
  
    Duration: 00:00:30.09, start: 0.000000, bitrate: 6977 kb/s
  
      Stream #0:0(eng): Audio: wmav2 (a[1][0][0] / 0x0161), 44100 Hz, stereo, fltp, 192 kb/s
  
      Stream #0:1(eng): Video: vc1 (Advanced) (WVC1 / 0x31435657), yuv420p, 1280x720, 5942 kb/s, 29.97 tbr, 1k tbn, 1k tbc
  
  Output #0, rawvideo, to 'pipe:':
  
    Metadata:
  
      SfOriginalFPS   : 299700
  
      WMFSDKVersion   : 11.0.6001.7000
  
      WMFSDKNeeded    : 0.0.0.0000
  
      comment         : Footage: Small World Productions, Inc; Tourism New Zealand | Producer: Gary F. Spradling | Music: Steve Ball
  
      title           : Wildlife in HD
  
      copyright       : © 2008 Microsoft Corporation
  
      IsVBR           : 0
  
      DeviceConformanceTemplate: AP@L3
  
      encoder         : Lavf55.33.100
  
      Stream #0:0(eng): Video: bmp, bgr24, 1280x720, q=2-31, 200 kb/s, 90k tbn, 29.97 tbc
  
  Stream mapping:
  
    Stream #0:1 -> #0:0 (vc1 -> bmp)
  
  Press [q] to stop, [?] for help
  
  frame=    3 fps=0.0 q=0.0 size=    8100kB time=00:00:00.10 bitrate=662902.1kbits/s    
  
  frame=   29 fps= 26 q=0.0 size=   78302kB time=00:00:00.96 bitrate=662902.3kbits/s    
  
  frame=   50 fps= 30 q=0.0 size=  135003kB time=00:00:01.66 bitrate=662902.2kbits/s    
  
  frame=   65 fps= 30 q=0.0 size=  175503kB time=00:00:02.16 bitrate=662902.2kbits/s    
  
  frame=   80 fps= 30 q=0.0 size=  216004kB time=00:00:02.66 bitrate=662902.1kbits/s    
  
  frame=   95 fps= 30 q=0.0 size=  256505kB time=00:00:03.16 bitrate=662902.1kbits/s    
  
  [asf @ 0x600059480] ff asf bad header 74  at:5053733
  
  [asf @ 0x600059480] invalid packet_length -1908511255 at:5053740
  
  [asf @ 0x600059480] ff asf bad header d4  at:5053759
  
  [asf @ 0x600059480] ff asf skip 55629 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5181733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5189733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5197733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5205733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5213733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5221733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5229733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5237733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5245733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5357733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5365733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5373733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5381733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5493733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5501733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5509733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5517733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5629733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5637733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5645733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5653733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5701733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5709733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5717733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5725733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5805733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5813733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5821733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5829733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5877733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5885733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5893733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5901733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5949733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5957733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5965733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] ff asf bad header 0  at:5973733
  
  [asf @ 0x600059480] ff asf skip 7991 (unknown stream)
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 15 times
  
  [asf @ 0x600059480] unexpected packet_replic_size of 2
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 7 times
  
  [asf @ 0x600059480] ff asf skip 2562 (unknown stream)
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 3 times
  
  [asf @ 0x600059480] ff asf skip 448 (unknown stream)
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 9 times
  
  [asf @ 0x600059480] unexpected packet_replic_size of 6
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 7 times
  
  [asf @ 0x600059480] packet_frag_size is invalid (1749-9)
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 13 times
  
  [asf @ 0x600059480] packet_frag_size is invalid (1749-9)
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 24 times
  
  [asf @ 0x600059480] unexpected packet_replic_size of 6
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 6 times
  
  [asf @ 0x600059480] unexpected packet_replic_size of 5
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 6 times
  
  [asf @ 0x600059480] packet_frag_size is invalid (1749-9)
  
  [asf @ 0x600059480] packet_obj_size invalid
  
  [asf @ 0x600059480] packet_frag_size is invalid (1749-9)
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 2 times
  
  [asf @ 0x600059480] unexpected packet_replic_size of 5
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 8 times
  
  [asf @ 0x600059480] unexpected packet_replic_size of 5
  
  [asf @ 0x600059480] packet_obj_size invalid
  
      Last message repeated 39 times
  
  [asf @ 0x600059480] packet_frag_size is invalid (1749-40)

• Long Overdue MediaWiki Upgrade

  5 février 2014, par Multimedia Mike — General

  What do I do ? What I do ? This library book is 42 years overdue !
  I admit that it’s mine, yet I can’t pay the fine,
  Should I turn it in or should I hide it again ?
  What do I do ? What do I do ?

  I internalized the forgoing paean to the perils of procrastination by Shel Silverstein in my formative years. It’s probably why I’ve never paid a single cent in late fees in my entire life.

  However, I have been woefully negligent as the steward of the MediaWiki software that drives the world famous MultimediaWiki, the internet’s central repository of obscure technical knowledge related to multimedia. It is currently running of version 1.6 software. The latest version is 1.22.

  The Story So Far
  According to my records, I first set up the wiki late in 2005. I don’t know which MediaWiki release I was using at the time. I probably conducted a few upgrades in the early days, but that went by the wayside perhaps in 2007. My web host stopped allowing shell access and the MediaWiki upgrade process pretty much requires running a PHP script from a command line. Upgrade time came around and I put off the project. Weeks turned into months turned into years until, according to some notes, the wiki abruptly stopped working in July, 2011. Suddenly, there were PHP errors about “Namespace” being a reserved word.

  While I finally laid out a plan to upgrade the wiki after all these years, I eventually found that the problem had been caused when my webhost upgraded from PHP 5.2 -> 5.3. I also learned of a small number of code changes that caused the problem to go away, thus kicking the can down the road once more.

  Then a new problem showed up last week. I think it might be related to a new version of PHP again. This time, a few other things on my site broke, and I learned that my webhost now allows me to select a PHP version to use (with the version then set to “auto”, which didn’t yield much information). Rolling back to an earlier version of PHP might have solved the problem easily.

  But NO ! I made the determination that this goes no further. I want this wiki upgraded.

  The Arduous Upgrade Path
  There are 2 general upgrade paths I can think of :
  

  1. Upgrade in place on the server
  2. Upgrade offline and put the site back on the server

  Approach #1 is problematic since I don’t have direct shell access, though I considered using something like PHP Shell. Approach #2 involves getting the entire set of wiki files and a backup of the MySQL tables. This is workable since I keep automated backups of these items anyway.

  In fairly short order, I was able to set up a working copy of the MultimediaWiki hosted on a local Linux machine. Now what’s the move ? The MediaWiki software I’m running is 1.6.10. The very latest, as of this upgrade project is 1.22.2. I suppose it’s way too much to hope that the software will upgrade cleanly from 1.6.x straight to 1.22.x, but I guess it’s worth a shot…

  HA ! No chance. Okay, next idea is to march through the various versions and upgrade each in turn. MediaWiki has all their historic releases online, all the way back to the 1.3 lineage. I decided that the latest of each lineage should upgrade cleanly from anything in the previous version of lineage. E.g., 1.6.10 should upgrade cleanly to 1.7.3 (last in the 1.7 series). This seemed to be a workable strategy. So I downloaded the latest of each series, unpacked, and copied all the wiki files over the working installation and ran ‘php update.php’ in the maintenance/ directory.

  The process is tedious and not without its obstacles. I consider this penance for my years of wiki neglect. First, I run into the “PHP Parse error : syntax error, unexpected T_NAMESPACE, expecting T_STRING” issue, the same that I saw years ago after the webhost transitioned from PHP 5.2 -> 5.3. I could solve this by editing assorted files and changing “Namespace” -> “MWNamespace” (which is what MediaWiki did by version 1.13). But I would prefer not to.

  Instead, I downloaded the source for PHP 5.2 and compiled it in a separate directory, then called ‘/path/to/php/5.2/bin/php update.php’. Problem solved.

  The next problem is that a bunch of the database update scripts are specifying “Type=InnoDB”. This isn’t supported by modern MySQL databases. Now, it’s “Engine=InnoDB”. A quick search & replace at the command line fixes this for 1.6.x… and 1.7.x… and 1.8 through 1.12. Finally, at 1.13, it was no longer necessary. As a bonus, at 1.13, I was able to test the installation since Namespace had been renamed to MWNamespace. I would later learn that the table type modifications probably could have been simplified in by changing “$wgDBmysql4 = true ;” to “$wgDBmysql5 = true ;” somewhere in LocalSettings.php.

  Command line upgrading worked smoothly up through 1.18 series when I got a new syntax error :

  <br />
PHP Fatal error:  Call to a member function addMessages() on a non-object in /mnt/sdb1/archive/wiki/extensions/Cite.php on line 68<br />

  Best I could do was comment out that line. I hope that doesn’t break anything important.

  In the home stretch, the very last transition (1.21 -> 1.22) failed :

  PHP Fatal error :  Cannot redeclare wfProfileIn() (previously declared in 
  /mnt/sdb1/archive/wiki/includes/profiler/Profiler.php:33) in 
  /mnt/sdb1/archive/wiki/includes/ProfilerStub.php on line 25
  

  Apparently, this problem arises occasionally since 1.18. I found a way around it thanks to this page : Deleted the file StartProfiler.php. Who am I to argue ?

  Upon completing the transition to 1.22, the wiki doesn’t look correct– the pictures aren’t showing up. The solution was to fix the temporary directory via LocalSettings.php.

  Back To Production
  Okay, it all works again ! Locally, that is. How to get it back to the server ? My first idea was that, knowing that this upgrade process can succeed, try stepping through the upgrade process again, but tell the update.php scripts to access the database tables on multimedia.cx. This seemed to be working for awhile, even though the database update phase often took 4-5 minutes. However, the transition from 1.8.5 -> 1.9.6 took 75 minutes and then timed out. According to my notes, “This isn’t going to work.”

  The new process :

  1. Dump the database tables from the local database.
  2. Create a new database remotely (melanson_wiki_ng).
  3. Dump the database table into melanson_wiki_ng.
  4. Move the index.php file out of the wiki files directory temporarily (or rename).
  5. Modify the LocalSettings.php to talk to the new database.
  6. Perform a lftp mirror operation in order to send all the files up to the server.
  7. Send the index.php file and hope beyond hope that everything magically works.

  And that’s the story of how the updated MultimediaWiki came back online. Despite the database dump file being over 110 MB, it only tool MySQL 1m45s to transmit it all to the remote server (let’s hear it for the ‘–compress’ option). For comparison, inserting the tables back into a fresh local database took 1m07s.

  When the MultimediaWiki was first live again, it loaded, but ever so slowly. This is when I finally looked into optimization and found that I was lacking any caching. So as a bonus, the MultimediaWiki should be much faster now.

  Going Forward
  For all I know, I did everything described here in the hardest way possible. But at least I got it done. Unless I learn of a better process, future upgrades will probably look similar to this.

  Additionally, I should probably take some time to figure out what new features are part of the standard MediaWiki distribution nowadays.