基于supervisor秒级Laravel定时任务

leeon 发布于2019-07-01 10:31 / 1871人阅读

摘要：背景介绍公司需要实现分钟内每隔秒轮训某个接口，自带的貌似只精确到分钟，虽然可以到精确到秒，但是并不满足需求。选型公司项目都是基于框架，所以这个没得选。

背景介绍

公司需要实现X分钟内每隔Y秒轮训某个接口，Linux自带的crontab貌似只精确到分钟，虽然可以到精确到秒，但是并不满足需求。

选型

公司项目都是基于 Laravel 框架，所以这个没得选。守护进程用的 supervisor，看看这个家伙能不能满足我们的需求

代码

namespace AppConsoleCommands;

use IlluminateConsoleCommand;
use Cache;
use CarbonCarbon;

class TaskCommand extends Command {

    /**
     * The name and signature of the console command.
     *
     * @var string
     */
    protected $signature = "ue:task
        {--id=      : 当前编号}
        {--max=     : 最大线程}
        {--sleep=   : 休眠多少毫秒}
        {--debug=   : 是否调试模式}
        ";

    /**
     * The console command description.
     *
     * @var string
     */
    protected $description = "Command description";

    /**
     * Create a new command instance.
     *
     * @return void
     */
    public function __construct() {
        parent::__construct();
    }

    /**
     * Execute the console command.
     *
     * @return mixed
     */
    public function handle() {
        $this->id       = $this->option("id") ?? "00";
        $this->max      = $this->option("max") ?? 32;
        $this->sleep    = $this->option("sleep") ?? 700;
        $this->debug    = $this->option("debug") ?? false;

        if ($this->id > $this->max) {
            return true;
        }

        while (true) {
            $this->doRun();
        }
    }

    /**
     * 
     * @param int $taskId
     * @return boolean
     */
    protected function doRun() {
        $lock = sprintf("task:%03d:%s", $this->id, time());
        $data = [
            "id" => $this->id,
            "max" => $this->max,
            "time"  => (new Carbon)->format("Y-m-d H:i:s.u"),
            "key" => $lock,
        ];
        try {
            $result = cache()->get($lock);
            if ($result) {
                $data["message"] = "Task Has been executed.";
                $this->wait($this->sleep);
                return true;
            }
            cache()->put($lock, true, 2);
            $data["message"] = "Task Executed.";
            $this->logger($data);
            $this->wait($this->sleep);
        } catch (Exception $ex) {
            $data["message"] = $ex->getMessage();
            cache()->put($data, true, 2);
            $this->wait($this->sleep);
        }
    }

    /**
     * 毫秒
     * @param string $time
     */
    protected function wait($time) {
        $wait = $time * 1000;
        usleep($wait);
    }

    protected function logger($message) {
        if($this->debug){
            $time   = (new Carbon)->format("Y-m-d H:i:s.u");
            $this->line(array_get($message, "message") ." - ". $time);
        }

        logger()->stack(["task"])->debug(null, $message);
    }

}

进程守护

[program:task-worker]
process_name=%(program_name)s_%(process_num)02d
command=/usr/bin/php /home/wwwroot/demo/artisan ue:task --id=%(process_num)02d --max=8
autostart=true
autorestart=true
user=www
numprocs=8
redirect_stderr=true
stdout_logfile=/home/wwwroot/demo/storage/logs/worker.log

上面是supervisor的配置

效果图

Task Executed. - 2018-08-14 22:17:18.985094
Task Executed. - 2018-08-14 22:17:19.336115
Task Executed. - 2018-08-14 22:17:20.038236
Task Executed. - 2018-08-14 22:17:21.090470
Task Executed. - 2018-08-14 22:17:22.142716
Task Executed. - 2018-08-14 22:17:23.195126
Task Executed. - 2018-08-14 22:17:24.247698
Task Executed. - 2018-08-14 22:17:25.300066
Task Executed. - 2018-08-14 22:17:26.352638
Task Executed. - 2018-08-14 22:17:27.054124
Task Executed. - 2018-08-14 22:17:28.106420
Task Executed. - 2018-08-14 22:17:29.158906
Task Executed. - 2018-08-14 22:17:30.211438
Task Executed. - 2018-08-14 22:17:31.263542
Task Executed. - 2018-08-14 22:17:32.315923
Task Executed. - 2018-08-14 22:17:33.017096
Task Executed. - 2018-08-14 22:17:34.068963
Task Executed. - 2018-08-14 22:17:35.121267
Task Executed. - 2018-08-14 22:17:36.173600
Task Executed. - 2018-08-14 22:17:37.226165

输出日志

[2018-08-14 22:12:24] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:24.389224","key":"task:001:1534255944","message":"Task Executed."} 
[2018-08-14 22:12:25] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:25.390158","key":"task:001:1534255945","message":"Task Executed."} 
[2018-08-14 22:12:26] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:26.391594","key":"task:001:1534255946","message":"Task Executed."} 
[2018-08-14 22:12:27] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:27.393196","key":"task:001:1534255947","message":"Task Executed."} 
[2018-08-14 22:12:28] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:28.395124","key":"task:001:1534255948","message":"Task Executed."} 
[2018-08-14 22:12:29] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:29.396796","key":"task:001:1534255949","message":"Task Executed."} 
[2018-08-14 22:12:30] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:30.398666","key":"task:001:1534255950","message":"Task Executed."} 
[2018-08-14 22:12:31] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:31.400561","key":"task:001:1534255951","message":"Task Executed."} 
[2018-08-14 22:12:32] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:32.402462","key":"task:001:1534255952","message":"Task Executed."} 
[2018-08-14 22:12:33] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:33.404092","key":"task:001:1534255953","message":"Task Executed."} 
[2018-08-14 22:12:34] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:34.405550","key":"task:001:1534255954","message":"Task Executed."} 
[2018-08-14 22:12:35] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:35.407197","key":"task:001:1534255955","message":"Task Executed."} 
[2018-08-14 22:12:36] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:36.408920","key":"task:001:1534255956","message":"Task Executed."} 
[2018-08-14 22:12:37] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:37.410841","key":"task:001:1534255957","message":"Task Executed."} 
[2018-08-14 22:12:38] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:38.412764","key":"task:001:1534255958","message":"Task Executed."} 
[2018-08-14 22:12:39] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:39.414518","key":"task:001:1534255959","message":"Task Executed."} 
[2018-08-14 22:12:40] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:40.416229","key":"task:001:1534255960","message":"Task Executed."} 
[2018-08-14 22:12:41] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:41.418001","key":"task:001:1534255961","message":"Task Executed."} 
[2018-08-14 22:12:42] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:42.419476","key":"task:001:1534255962","message":"Task Executed."} 
[2018-08-14 22:12:43] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:43.421388","key":"task:001:1534255963","message":"Task Executed."} 
[2018-08-14 22:12:44] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:44.423164","key":"task:001:1534255964","message":"Task Executed."} 
[2018-08-14 22:12:45] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:45.424798","key":"task:001:1534255965","message":"Task Executed."} 
[2018-08-14 22:12:46] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:46.426667","key":"task:001:1534255966","message":"Task Executed."} 
[2018-08-14 22:12:47] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:47.428553","key":"task:001:1534255967","message":"Task Executed."} 
[2018-08-14 22:12:48] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:48.430427","key":"task:001:1534255968","message":"Task Executed."} 
[2018-08-14 22:12:49] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:49.432118","key":"task:001:1534255969","message":"Task Executed."} 
[2018-08-14 22:12:50] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:50.433893","key":"task:001:1534255970","message":"Task Executed."} 
[2018-08-14 22:12:51] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:51.435711","key":"task:001:1534255971","message":"Task Executed."} 
[2018-08-14 22:12:52] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:52.437015","key":"task:001:1534255972","message":"Task Executed."} 
[2018-08-14 22:12:53] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:53.438352","key":"task:001:1534255973","message":"Task Executed."} 
[2018-08-14 22:12:54] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:54.439989","key":"task:001:1534255974","message":"Task Executed."} 
[2018-08-14 22:12:55] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:55.441580","key":"task:001:1534255975","message":"Task Executed."} 
[2018-08-14 22:12:56] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:56.443116","key":"task:001:1534255976","message":"Task Executed."} 
[2018-08-14 22:12:57] local.DEBUG:  {"id":"1","max":"32","time":"2018-08-14 22:12:57.445006","key":"task:001:1534255977","message":"Task Executed."}

云服务器 GPU云服务器定时任务与触发任务定时任务实现定时任务网站定时任务

文章版权归作者所有，未经允许请勿转载,若此文章存在违规行为，您可以联系管理员删除。

转载请注明本文地址：https://www.ucloud.cn/yun/29247.html

Docker 使用 supervisord 管理 lumen队列与crontab

摘要：之前在内使用的队列服务做了一个异步，处理一些内容审核的相关操作。但是每次重启容器之后都需要进入内部启动的队列进程虽然文档内有写使用管理进程，但是并没有那么做。。，最近需求上需要使用，所以决定使用来管理这些进程。所以使用了一个脚本，在执行它。之前在docker内使用lumen的队列服务做了一个异步，处理一些内容审核的相关操作。但是每次重启容器之后都需要进入docker内部启动lumen...

cyqian 2019-07-01 11:24 评论0 收藏0
Docker 使用 supervisord 管理 lumen队列与crontab

摘要：之前在内使用的队列服务做了一个异步，处理一些内容审核的相关操作。但是每次重启容器之后都需要进入内部启动的队列进程虽然文档内有写使用管理进程，但是并没有那么做。。，最近需求上需要使用，所以决定使用来管理这些进程。所以使用了一个脚本，在执行它。之前在docker内使用lumen的队列服务做了一个异步，处理一些内容审核的相关操作。但是每次重启容器之后都需要进入docker内部启动lumen...

hlcc 2019-06-28 17:06 评论0 收藏0
Supervisor 从入门到放弃

摘要：前言是一个客户端服务器系统，允许其用户在类操作系统上控制许多进程。这将打印一个示例的配置文件到您的终端。不会自动生成配置文件。具体可见官方文档后台提供的后台管理比较简单大致功能有重启启动停止进程，打印日志，清除日志等。 showImg(https://segmentfault.com/img/bVbgXm1?w=242&h=45); 前言 Supervisor是一个客户端/服务器系统，...

whjin 2019-07-01 12:31 评论0 收藏0