Missing Completed X tasks of Y in kedro 0.17.5

[rnoxy]

Hello,

I have upgraded kedro to the version 0.17.5 and unfortunatelly I cannot see the INFO logs on the console about completed X tasks of Y. I am pretty sure I had such messages with kedro 0.17.4.
Any help?

[datajoely]

Hi @rnoxy we've not made any changes to that - so it must be something to do with the way you've set things up.

Can you tell me more about what your project looks like? Is this an upgraded 0.17.4 project or a new one?

[datajoely]

Can you see any log messages when you do a kedro run? If your logging.yml unchanged?

[rnoxy]

I have just upgraded via command
pip install --upgrade kedro

Now I do not see such messages.
Here is buch of log I had before I upgraded.

2021-10-29 16:28:22,141 - kedro.runner.sequential_runner - INFO - Completed 22 out of 29 tasks
2021-10-29 16:28:56,645 - kedro.runner.sequential_runner - INFO - Completed 23 out of 29 tasks
2021-10-29 16:28:56,842 - kedro.runner.sequential_runner - INFO - Completed 24 out of 29 tasks
2021-10-29 16:29:15,925 - kedro.runner.sequential_runner - INFO - Completed 1 out of 7 tasks
2021-10-29 16:29:16,803 - kedro.runner.sequential_runner - INFO - Completed 2 out of 7 tasks
2021-10-29 16:29:19,524 - kedro.runner.sequential_runner - INFO - Completed 25 out of 29 tasks
2021-10-29 16:29:19,591 - kedro.runner.sequential_runner - INFO - Completed 26 out of 29 tasks
2021-10-29 16:29:19,618 - kedro.runner.sequential_runner - INFO - Completed 27 out of 29 tasks
2021-10-29 16:29:19,778 - kedro.runner.sequential_runner - INFO - Completed 28 out of 29 tasks
2021-10-29 16:29:19,872 - kedro.runner.sequential_runner - INFO - Completed 29 out of 29 tasks
2021-10-29 16:29:31,855 - kedro.runner.sequential_runner - INFO - Completed 3 out of 7 tasks

[datajoely]

and now when you do kedro run - what do you see?

[rnoxy]

Ok, I have found the reason. I have also changed this line in logging.yml

root:
    level: WARNING
    handlers: [console, info_file_handler, error_file_handler]

If I use level: INFO then I see Completed ..., but with WARNING there is no such message.
Is it ok? I thought that WARNING is more verbose, isn't ?

[datajoely]

The logging hierarchy in Python works as follows - warning is less verbose than info.

This website has a nice description:

1. DEBUG: Detailed information, for diagnosing problems. Value=10.
2. INFO: Confirm things are working as expected. Value=20.
3. WARNING: Something unexpected happened, or indicative of some problem. But the software is still working as expected. Value=30.
4. ERROR: More serious problem, the software is not able to perform some function. Value=40
5. CRITICAL: A serious error, the program itself may be unable to continue running. Value=50

[rnoxy]

I understand. Many thanks