Magento – Configuration of a Queue CRON job

magento-cronmagento2queue

I have a MySQL-based queue that has been added by a custom extension and I'd like to know how to configure the CRON to run that queue process.

The Magento documentation has this to say about how to run a Magento 2 Queue using a CRON job:

After consuming all available messages, the command terminates. You can run the command again manually or with a cron job. … For example, you can append & to the command to run it in the background, return to a prompt, and continue running commands (e.g., bin/magento queue:consumers:start <consumer_name> &).

Based on the documentation, I would think you'd configure a CRON job like this:

* * * * * /var/www/stage/current/bin/magento queue:consumers:start <NAME OF QUEUE> &

However if I run just /var/www/stage/current/bin/magento queue:consumers:start <NAME OF QUEUE> & on the command line, the process runs for a long time (potentially indefinitely?), so I can't see how running that command every minute from the CRON job would work, as you'd have an ever-increasing number of processes running.

What is the recommended way to run a MySQL queue from the command line?

Best Answer

After talking with David Alger about this, I've determined the following:

The standard Magento CRON configuration will run Magento 2 queues without any special configuration of the CRON, so a special crontab configuration in order to run queues is not strictly necessary. However if the CRON is processing a long-running CRON job, your queue might not get processed every minute. So to ensure that the queue runs at least once a minute, you can configure it to run like this:

* * * * * cd <PATH TO MAGENTO> && ( ps x | grep [n]ameOfQueue >>/dev/null 2>&1 || bin/magento queue:consumers:start nameOfQueue)

Where nameOfQueue is the name of the queue that you're wanting to run. You can retrieve a list of all queues using this command:

bin/magento queue:consumers:list

Related Solutions

Magento – Can someone give detailed explanation about scheduling in Magento 2 cron job

This can not be a complete answer to my question about detailed explanation of how Magento's cron schedule works and admin config parameters, but there are few notices:

System cron schedule must be more frequent then magento's cron job schedule. In other case it will skip tasks.
In case of above notice there is no need to include bin/magento cron:run command in system cron twice.
As for magento docs it's recomended to run default magento's cron tasks every minute.
There is also config for cron groups in admin panel in which there is a "Generate Schedules Every" parameter. It affects on cron job launch frequency (job can not launch more frequent than this parameter specifies). What for "Schedule Ahead For" it's a mystery for me for now.

Therefore, for example, if I set system cron to run every minute:

* * * * * /usr/bin/php /srv/www/my_directory/bin/magento cron:run

set up cron job (which is in default group) to run every 5 minutes:

> <group id="default">
>     <job name="my_custom_job" instance="My\Module\Cron\MyCustomJob" method="execute">
>         <schedule>*/5 * * * *</schedule>
>     </job>
> </group>

and in admin config panel leave default values ("Generate Schedules Every" 15 minutes),

than my cron job will run every 15 minutes (as admin config limits).

For more frequent launching I must create custom group with other parameters.

Magento2 Cron Job Not Running Automatically – Troubleshooting Guide

Try this:

just run this command in terminal crontab -e then paste below code in terminal.

* * * * * <path to php binary> <magento install dir>/bin/magento cron:run

After pasting that code press CTRL + X key then you will see this message.

Save modified buffer (ANSWERING "No" WILL DESTROY CHANGES) ?

Now press Y now you will see this type of message.

File Name to Write: /tmp/{{you will see temp name}}/crontab Just press ENTER And cron set.

It will call every minute Magento cron and Magento will manage your extension's cron and run as per configured time.

After cron configuration you just need to flush the cache.

Best Answer

Related Solutions

Magento – Can someone give detailed explanation about scheduling in Magento 2 cron job

Magento2 Cron Job Not Running Automatically – Troubleshooting Guide

Related Topic