Recherche avancée

Sur d’autres sites (7589)

• Announcement : Piwik to focus on Reliability, Performance and Security

  7 octobre 2014, par Matthieu Aubry — About, Community

  To our valued team and community,

  Well, we have moved fast and achieved so much during the past few months. Relentlessly releasing major version after major version… We got a lot done including several major new features !

  The speed of adding new features was a great showcase of how agile our small teams and the larger community are. And I’m so proud to see automated testing becoming common practice among everyone hacking on Piwik !

  For the next few months until the new year we will focus on making what we have better. We will fix those rare but longstanding critical bugs, and aim to solve all Major issues and other must-have performance and general improvements. The core team and Piwik PRO will have the vision of making the existing Piwik and all plugins very stable and risk free. This includes edge cases, general bugs but also specific performance issues for high traffic or issues with edge case data payloads.

  We’ll be more pro-active and take Piwik platform to the next level of Performance, Security, Privacy & Reliability ! We will prove to the world that Free/Libre Web software can be of the highest standard of quality. By focusing on quality we will make Piwik even easier to maintain and improve in the future. We are building the best open platform that will let every user liberate their data and keep full control of it.

  If you have any feedback or questions get in touch or let’s continue the discussion in the forum.

  Thank you for your trust and for liberating your data with Piwik,

  Matthieu Aubry
  Piwik founder

  More information

  • How long is each release of Piwik maintained for ? (FAQ)
  • When is the next release of Piwik ? What is the release schedule ? (FAQ)
  • Pulse of Piwik : our monthly pulse report shows 27 different people contributed to Piwik core in the last month !

  

  This is an amazing testament of the power of free/libre software and yet we think this is just the beginning. We hope more developers will join and contribute to the Piwik project !

• Announcement : Piwik to focus on Reliability, Performance and Security

  7 octobre 2014, par Matthieu Aubry — About, Community

  To our valued team and community,

  Well, we have moved fast and achieved so much during the past few months. Relentlessly releasing major version after major version… We got a lot done including several major new features !

  The speed of adding new features was a great showcase of how agile our small teams and the larger community are. And I’m so proud to see automated testing becoming common practice among everyone hacking on Piwik !

  For the next few months until the new year we will focus on making what we have better. We will fix those rare but longstanding critical bugs, and aim to solve all Major issues and other must-have performance and general improvements. The core team and Piwik PRO will have the vision of making the existing Piwik and all plugins very stable and risk free. This includes edge cases, general bugs but also specific performance issues for high traffic or issues with edge case data payloads.

  We’ll be more pro-active and take Piwik platform to the next level of Performance, Security, Privacy & Reliability ! We will prove to the world that Free/Libre Web software can be of the highest standard of quality. By focusing on quality we will make Piwik even easier to maintain and improve in the future. We are building the best open platform that will let every user liberate their data and keep full control of it.

  If you have any feedback or questions get in touch or let’s continue the discussion in the forum.

  Thank you for your trust and for liberating your data with Piwik,

  Matthieu Aubry
  Piwik founder

  More information

  • How long is each release of Piwik maintained for ? (FAQ)
  • When is the next release of Piwik ? What is the release schedule ? (FAQ)
  • Pulse of Piwik : our monthly pulse report shows 27 different people contributed to Piwik core in the last month !

  

  This is an amazing testament of the power of free/libre software and yet we think this is just the beginning. We hope more developers will join and contribute to the Piwik project !

• How can I avoid an ffmpeg out of memory error

  21 mars 2021, par Silentfury

  I use ffmpeg with complex filtering. Input are different sets of FULLHD surveilance camera videos each 10 to 15 seconds long. Set size (number of videos per set) varies. To remove unchanged frames I apply mpdecimate. To avoid being triggered by moving bushes but still keep objects I want to remain, I apply a complex filter :

  


  

  • split the video (the original and a dummy to detect motion/stills)

  


  • scale the dummy down (so the 8x8-block-metric of mpdecimate matches the size of moving objects I want to keep)

  


  • add white boxes to dummy to mask unintendedly moving objects

  


  • apply mpdecimate to dummy to remove non-changing frames

  


  • scale dummy back to original size

  


  • overlay the remaining frames of dummy with matching frames of original

  


  


  All this works fine if the number of input videos is small (less than 100). The memory consupmtion of the ffmpeg process varies somewhere between 2GiB and 5GiB.

  


  If the number of input files gets larger (say 200), the memory consumption suddenly jumps to insane numbers until memory (32GiB plus 33GiB swap) runs out and ffmpeg gets killed. I can not predict if and why this happens. I have one example, where a set of 340 videos worked using 6GiB. Any other set above 100 videos I tried eats all RAM in under two minutes and dies.

  


  There is no particular error message from ffmpeg.

  


  dmesg says :

  


  Out of memory: Kill process 29173 (ffmpeg)
Killed process 29173 (ffmpeg) total-vm:66707800kB


  


  My ffmpeg command :

  


  ffmpeg -f concat -safe 0 -i vidlist -vf 'split=2[full][masked];[masked]scale=w=iw/4:h=ih/4,drawbox=w=51:h=153:x=101:y=0:t=fill:c=white,drawbox=w=74:h=67:x=86:y=49:t=fill:c=white,drawbox=w=51:h=149:x=258:y=0:t=fill:c=white,drawbox=w=13:h=20:x=214:y=103:t=fill:c=white,drawbox=w=29:h=54:x=429:y=40:t=fill:c=white,drawbox=w=35:h=49:x=360:y=111:t=fill:c=white,drawbox=w=26:h=54:x=304:y=92:t=fill:c=white,drawbox=w=48:h=27:x=356:y=105:t=fill:c=white,drawbox=w=30:h=27:x=188:y=124:t=fill:c=white,drawbox=w=50:h=54:x=371:y=7:t=fill:c=white,drawbox=w=18:h=38:x=248:y=107:t=fill:c=white,drawbox=w=21:h=51:x=242:y=33:t=fill:c=white,mpdecimate=hi=64*80:lo=64*40:frac=0.001,scale=w=iw*4:h=ih*4[deduped];[deduped][full]overlay=shortest=1,setpts=N/(15*TB),mpdecimate=hi=64*80:lo=64*50:frac=0.001,setpts=N/(15*TB)' -r 15 -c:v libx265 -preset slower -crf 37 -pix_fmt yuv420p -an result.mkv


  


  ffmpeg version 4.1.6

  


  Debian 4.19.171-2

  


  I hope that my filter can be tuned in some way that achieves the same result but doesn't eat RAM that much - but I have no clue how. Within reasonable limits, I wouldn't mind if processing time suffers. Any hints appreciated.