Recherche avancée

Sur d’autres sites (4639)

• How to create a scheduled task – Introducing the Piwik Platform

  28 août 2014, par Thomas Steur — Development

  This is the next post of our blog series where we introduce the capabilities of the Piwik platform (our previous post was How to create a custom theme in Piwik). This time you’ll learn how to execute scheduled tasks in the background, for instance sending a daily email. For this tutorial you will need to have basic knowledge of PHP.

  What can you do with scheduled tasks ?

  Scheduled tasks let you execute tasks regularly (hourly, weekly, …). For instance you can :

  • create and send custom reports or summaries
  • sync users and websites with other systems
  • clear any caches
  • import third-party data into Piwik
  • monitor your Piwik instance
  • execute any other task you can think of

  Getting started

  In this series of posts, we assume that you have already set up your development environment. If not, visit the Piwik Developer Zone where you’ll find the tutorial Setting up Piwik.

  To summarize the things you have to do to get setup :

  • Install Piwik (for instance via git).
  • Activate the developer mode : ./console development:enable --full.
  • Generate a plugin : ./console generate:plugin --name="MyTasksPlugin". There should now be a folder plugins/MyTasksPlugin.
  • And activate the created plugin under Settings => Plugins.

  Let’s start creating a scheduled task

  We start by using the Piwik Console to create a tasks template :

  ./console generate:scheduledtask

  The command will ask you to enter the name of the plugin the task should belong to. I will simply use the above generated plugin name “MyTasksPlugin”. There should now be a file plugins/MyTasksPlugin/Tasks.php which contains some examples to get you started easily :

  class Tasks extends \Piwik\Plugin\Tasks
  
  {
  
      public function schedule()
  
      {
  
          $this->hourly('myTask');  // method will be executed once every hour
  
          $this->daily('myTask');   // method will be executed once every day
  
          $this->weekly('myTask');  // method will be executed once every week
  
          $this->monthly('myTask'); // method will be executed once every month
  
  
  
          // pass a parameter to the task
  
          $this->weekly('myTaskWithParam', 'anystring');
  
  
  
          // specify a different priority
  
          $this->monthly('myTask', null, self::LOWEST_PRIORITY);
  
          $this->monthly('myTaskWithParam', 'anystring', self::HIGH_PRIORITY);
  
      }
  
  
  
      public function myTask()
  
      {
  
          // do something
  
      }
  
  
  
      public function myTaskWithParam($param)
  
      {
  
          // do something
  
      }
  
  }

  A simple example

  As you can see in the generated template you can execute tasks hourly, daily, weekly and monthly by registering a method which represents the actual task :

  public function schedule()
  
  {
  
      // register method remindMeToLogIn to be executed once every day
  
      $this->daily('remindMeToLogIn');  
  
  }
  
  
  
  public function remindMeToLogIn()
  
  {
  
      $mail = new \Piwik\Mail();
  
      $mail->addTo('me@example.com');
  
      $mail->setSubject('Check stats');
  
      $mail->setBodyText('Log into your Piwik instance and check your stats!');
  
      $mail->send();
  
  }

  This example sends you an email once a day to remind you to log into your Piwik daily. The Piwik platform makes sure to execute the method remindMeToLogIn exactly once every day.

  How to pass a parameter to a task

  Sometimes you want to pass a parameter to a task method. This is useful if you want to register for instance one task for each user or for each website. You can achieve this by specifying a second parameter when registering the method to execute.

  public function schedule()
  
  {
  
      foreach (\Piwik\Site::getSites() as $site) {
  
          // create one task for each site and pass the URL of each site to the task
  
          $this->hourly('pingSite', $site['main_url']); 
  
      }
  
  }
  
  
  
  public function pingSite($siteMainUrl)
  
  {
  
      file_get_contents($siteMainUrl);
  
  }

  How to test scheduled tasks

  After you have created your task you are surely wondering how to test it. First, you should write a unit or integration test which we will cover in one of our future blog posts. Just one hint : You can use the command ./console generate:test to create a test. To manually execute all scheduled tasks you can execute the API method CoreAdminHome.runScheduledTasks by opening the following URL in your browser :

  http://piwik.example.com/index.php?module=API&method=CoreAdminHome.runScheduledTasks&token_auth=YOUR_API_TOKEN

  Don’t forget to replace the domain and the token_auth URL parameter.

  There is one problem with executing the scheduled tasks : The platform makes sure they will be executed only once an hour, a day, etc. This means you can’t simply reload the URL and test the method again and again as you would have to wait for the next hour or day. The proper solution is to set the constant DEBUG_FORCE_SCHEDULED_TASKS to true within the file Core/TaskScheduler.php. Don’t forget to set it back to false again once you have finished testing it.

  Starting from Piwik 2.6.0 you can alternatively execute the following command :

  ./console core:run-scheduled-tasks --force --token-auth=YOUR_TOKEN_AUTH

  The option “–force” will make sure to execute even tasks that are not due to run at this time. So you won’t have to modify any files.

  Which tasks are registered and when is the next execution time of my task ?

  The TasksTimetable plugin from the Marketplace can answer this question for you. Simply install and activate the plugin with one click by going to Settings => Marketplace => Get new functionality. It’ll add a new admin menu item under Settings named Scheduled Tasks.

  Publishing your Plugin on the Marketplace

  In case you want to share your task(s) with other Piwik users you can do this by pushing your plugin to a public GitHub repository and creating a tag. Easy as that. Read more about how to distribute a plugin.

  Advanced features

  Isn’t it easy to create scheduled tasks ? We never even created a file ! Of course, based on our API design principle “The complexity of our API should never exceed the complexity of your use case.” you can accomplish more if you want. For instance, you can define priorities, you can directly register methods from different objects and classes, you can specify at which time of a day a task should run and more.

  Would you like to know more about tasks ? Go to our Tasks class reference in the Piwik Developer Zone.

  If you have any feedback regarding our APIs or our guides in the Developer Zone feel free to send it to us.

• Traceback error with Python when using ffmpeg to convert a video

  16 mai 2013, par TheMickeyNick

  The simple way my script runs is the user provides a folder location and a filetype and glob.glob() finds the files with the filetype provided and adds them to a list. It then uses a for loop and goes through the list and converts each video. But it doesn't like when I try to run my ffmpeg command. Any help would be awesome. I'm also using Win 7 64 bit with 64 bit ffmpeg and Python 3.3
  Here's the error :

  OS Error
  
  Traceback (most recent call last):
  
    File "C:\Python33\lib\subprocess.py", line 1106, in _execute_child
  
      startupinfo)
  
  FileNotFoundError: [WinError 2] The system cannot find the file specified
  
  
  
  During handling of the above exception, another exception occurred:
  
  
  
  Traceback (most recent call last):
  
    File "C:\Users\user\Workspace\PythonConverter\HTMLandPythonConverter\Converter.py", line 77, in <module>
  
      massConvert(fileNames)
  
    File "C:\Users\user\Workspace\PythonConverter\HTMLandPythonConverter\Converter.py", line 47, in massConvert
  
      convertVideotoNewFormat(&#39;.mp4&#39;, x)
  
    File "C:\Users\user\Workspace\PythonConverter\HTMLandPythonConverter\Converter.py", line 61, in convertVideotoNewFormat
  
      myFile = subprocess.Popen(ffmpegString)#, stdout=subprocess.PIPE, stderr=subprocess.PIPE
  
    File "C:\Python33\lib\subprocess.py", line 820, in __init__
  
      restore_signals, start_new_session)
  
    File "C:\Python33\lib\subprocess.py", line 1112, in _execute_child
  
      raise WindowsError(*e.args)
  
  FileNotFoundError: [WinError 2] The system cannot find the file specified
  
  </module>

  Here is my code :

  import subprocess
  
  from subprocess import call
  
  import glob
  
  
  
  fileNames = []
  
  fileLocation = {}
  
  filetype = {}
  
  def convertString(location):
  
      s = list(location)
  
      for i in range(len(s)):
  
          if s[i] in '\\':
  
              s[i] = '/'
  
  
  
      if s[len(s)-1] != '/':
  
          s.append('/')
  
      location = "".join(s)
  
      return location
  
  
  
  def convertStringBack(stringTo):
  
      s = list(stringTo)
  
      for i in range(len(s)):
  
          if s[i] in '/':
  
              s[i] = '\\'
  
      stringTo = "".join(s)
  
      return stringTo
  
  
  
  def fileTypeTester():
  
      FieldType = '*' + input('What\'s the file type we are converting from?')
  
      typeSplit = list(FieldType)
  
      if typeSplit[1] != '.':
  
          typeSplit.insert(1,'.')
  
      FieldType = "".join(typeSplit)
  
      if FieldType not in ['*.flv','*.kdb']:
  
          print('Not a valid file type')
  
      else:
  
          return FieldType
  
      return None
  
  
  
  def massConvert(listOfFiles):
  
      print('Starting Conversion')
  
      for x in listOfFiles:
  
          #x = convertStringBack(x)
  
          print('Converting ' + x + ' to .mp4')
  
          convertVideotoNewFormat('.mp4', x)
  
      print('Finished File Conversion')
  
  
  
  
  
  def convertVideotoNewFormat(newFormat, fileLoc):
  
      newFilePath = fileLoc[0:len(fileLoc)-4]
  
      ffmpegString = ["ffmpeg64","-i", fileLoc,"-qscale","0","-ar","22050","-vcodec","libx264",newFilePath,newFormat]
  
      try:
  
          subprocess.check_call(newFilePath)
  
      except OSError:
  
          print('OS Error')
  
      except subprocess.CalledProcessError:
  
          print('Subprocess Error')
  
      myFile = subprocess.Popen(ffmpegString)
  
      print(myFile)
  
  
  
  #This will replace old HTML flv object tag with new video tag, but it is yet to be implemented
  
  def replaceHTML():
  
      pass
  
  
  
  fileLocation = input('What is the path of the files you\'d like to convert?')
  
  fileLocation = convertString(fileLocation)
  
  fileType = fileTypeTester()
  
  fileNames = glob.glob(fileLocation + fileType)
  
  massConvert(fileNames)

  I've looked around and most of the tutorials are in 2.7 the code is 3.3 and I can't find a tutorial to use ffmpeg for 3.3. My ffmpeg is set to 'ffmpeg64' on my PATH.

  Thanks !

• Anomalie #3095 : Le filtre |image_renforcement ne préserve pas la transparence des images

  18 juillet 2014, par tcharlss ಠ_ಠ

  Il s’agit d’un LAMP local installé sur Ubuntu 14.04.
  La librairie GD (libgd3 2.1.0-3) ainsi que le module GD pour PHP5 (php5-gd 5.5.9) sont bien installés.
  Testé avec des images PNG en couleur et en noir et blanc : même résultat.
  Dans « Génération de miniatures des images », j’ai essayé toutes les méthodes : GD1, GD2, Convert et Netpbm.

  S’il s’agit bien d’une librairie manquante sur le serveur, il me semble que le filtre ne devrait rien faire au lieu d’aplatir l’image.