concurrency in practiceWork stealing is well suited to problems in which consumers are also producers—when performing a unit of work is likely to result in the identification of more work. For example, processing a page in a web crawler usually results in the identification of new pages to be crawled. Similarly, many graph-exploring algorithms, such as marking the heap during garbage collection, can be efficiently parallelized using work stealing. When a worker identifies a new unit of work, it places it at the end of its own deque (or alternatively, in a work sharing design, on that of another worker); when its deque is empty, it looks for work at the end of someone else’s deque, ensuring that each worker stays busy.


не могу что-то понять о чем речь.

Первую фразу понял, что Work stealing подходит для таких случае когда consumer является продюсером. Дальше чего-то не понял я примеров.

Можете мысль про краулер и the identification of more work