Increased Linux kernel timer frequency delivers big boost in AI workloads

[Pelican Press 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

Increased Linux kernel timer frequency delivers big boost in AI workloads

At the weekend, a

This is the hidden content, please

• Sign In
• or
• Sign Up

engineer proposed raising the default Linux kernel timer frequency from 250 Hz to 1,000 Hz. Linux-centric tech site

This is the hidden content, please

• Sign In
• or
• Sign Up

has quickly stepped up and assessed what the change might mean to users with a suite of A/B testing. Spoiler alert: The most notable benefits were seen in AI LLM acceleration. Elsewhere, the differences might be considered within the margin of error of system benchmarking. System power consumption changes seen in the comparison were also minimal.

Let’s recap the patch statement shared by

This is the hidden content, please

• Sign In
• or
• Sign Up

engineer Qais Yousef on Sunday before looking at some measured impacts. As mentioned, Yousef’s main thrust was to propose that the current Linux kernel default to a timer frequency of 1,000Hz. The reasoning behind the proposal was that Linux users would benefit from improved responsiveness and faster workload completion in general.

Yousef also thought that moving to 1,000 Hz would banish the 250 Hz-related issues with “scheduler decisions such as imprecise time slices, delayed load balance, delayed stats updates, and other related complications,” reported Phoronix. Toward the end of his patch notes, the engineer openly pondered over system power consumption, assuming that “the faster TICK might still result in higher power.”

Phoronix’s beefy AMD Ryzen 9 9950X (16C/32T) system with 32GB RAM and a Radeon RX 7900 XTX graphics card was the A/B Linux kernel timer frequency testing test bed. We see the first set of tests for processing performance in Llama LLMs, measured in tokens per second. This is probably the greatest showcase for the move to 1,000 Hz, with benefits from the change edging into double figures. However, the Nginx web server also showed double-figure percentage gains in requests handled per second, benefitting more with more connections.

Other test results shared included image processing (250 Hz win), SQL database manipulation (evens), gaming (probably unnoticeable but consistent benefit for 1,000 Hz), browsing, rendering, and compiling (all even).

Interestingly, the frequency difference precipitated a negligible change in power CPU consumption differences. We’ve shared some of the numbers and charts from Phoronix (above), but check out the original post for fuller details.

Lastly, we must highlight that some popular Linux distributions already have a 1,000 Hz default kernel timer frequency. Ubuntu and SteamOS are already in the 1,000 Hz camp, for example. Nevertheless, changing the default would help bring the plethora of other distros in line.

Get Tom’s Hardware’s best news and in-depth reviews, straight to your inbox.

This is the hidden content, please

• Sign In
• or
• Sign Up

#Increased #Linux #kernel #timer #frequency #delivers #big #boost #workloads

This is the hidden content, please

• Sign In
• or
• Sign Up

This is the hidden content, please

• Sign In
• or
• Sign Up