UL Benchmarks - PCMark and 3DMark

This section deals with a couple of UL Futuremark benchmarks - PCMark 10 and 3DMark. While PCMark evaluates the system as a whole, 3DMark focuses on the graphics capabilities with emphasis on gaming workloads.

PCMark 10

UL's PCMark 10 evaluates computing systems for various usage scenarios (generic / essential tasks such as web browsing and starting up applications, productivity tasks such as editing spreadsheets and documents, gaming, and digital content creation). We benchmarked select PCs with the PCMark 10 Extended profile and recorded the scores for various scenarios. These scores are heavily influenced by the CPU and GPU in the system, though the RAM and storage device also play a part. The power plan was set to Balanced for all the PCs while processing the PCMark 10 benchmark.

Futuremark PCMark 10 - Essentials

Futuremark PCMark 10 - Productivity

Futuremark PCMark 10 - Gaming

Futuremark PCMark 10 - Digital Content Creation

Futuremark PCMark 10 - Extended

3DMark

UL's 3DMark comes with a diverse set of graphics workloads that target different Direct3D feature levels. Correspondingly, the rendering resolutions are also different. We use 3DMark 2.4.4264 to get an idea of the graphics capabilities of the system. In this section, we take a look at the performance of the OnLogic Helix HX500 across the different 3DMark workloads.

3DMark Ice Storm

This workload has three levels of varying complexity - the vanilla Ice Storm, Ice Storm Unlimited, and Ice Storm Extreme. It is a cross-platform benchmark (which means that the scores can be compared across different tablets and smartphones as well). All three use DirectX 11 (feature level 9) / OpenGL ES 2.0. While the Extreme renders at 1920 x 1080, the other two render at 1280 x 720. The graphs below present the various Ice Storm worloads' numbers for different systems that we have evaluated.

UL 3DMark - Ice Storm Workloads

3DMark Cloud Gate

The Cloud Gate workload is meant for notebooks and typical home PCs, and uses DirectX 11 (feature level 10) to render frames at 1280 x 720. The graph below presents the overall score for the workload across all the systems that are being compared.

UL 3DMark Cloud Gate Score

3DMark Fire Strike

The Fire Strike benchmark has three workloads. The base version is meant for high-performance gaming PCs. Similar to Sky Diver, it uses DirectX 11 (feature level 11) to render frames at 1920 x 1080. The Extreme version targets 1440p gaming requirements, while the Ultra version targets 4K gaming system, and renders at 3840 x 2160. The graph below presents the overall score for the Fire Strike Extreme and Fire Strike Ultra benchmark across all the systems that are being compared.

UL 3DMark - Fire Strike Workloads

3DMark Time Spy

The Time Spy workload has two levels with different complexities. Both use DirectX 12 (feature level 11). However, the plain version targets high-performance gaming PCs with a 2560 x 1440 render resolution, while the Extreme version renders at 3840 x 2160 resolution. The graphs below present both numbers for all the systems that are being compared in this review.

UL 3DMark - Time Spy Workloads

3DMark Night Raid

The Night Raid workload is a DirectX 12 benchmark test. It is less demanding than Time Spy, and is optimized for integrated graphics. The graph below presents the overall score in this workload for different system configurations.

UL 3DMark Fire Strike Extreme Score

3DMark CPU Profile Benchmark

UL recently introduced a benchmark to test the multi-threaded capabilities of the CPU in a system. Since gaming workloads are often multi-threaded, it makes sense to include this testing as part of the 3DMark suite. The benchmark routine attempts to perform the simulation of birds / bird-like objects flocking together using as many advanced capabilities as offered by the processor. The workload is configured to run with different number of threads ranging from 1 to 16 (and a single entry for the maximum number of threads allowed in the system).

UL 3DMark - CPU Profile Benchmark

We present the benchmark results for the single and maximum threads case above.

For graphics workloads, the Intel UHD Graphics 630 is quite weak even when compared against the one in the Bean Canyon NUC (a 28W TDP processor cooled with the Akasa Turing fanless chassis). For CPU workloads, the HX500 manages to inch ahead, thanks to the presence of additional cores and slightly higher power budget.

BAPCo SYSmark 25 Power Consumption and Thermal Performance
Comments Locked

32 Comments

View All Comments

  • Oxford Guy - Friday, September 17, 2021 - link

    130W with a 120W adapter.

    Thermal throttling.

    Double failure.
  • Oxford Guy - Friday, September 17, 2021 - link

    138W.
  • Wrs - Saturday, September 18, 2021 - link

    No issue there. Adapter is rated for DC output; review measured AC input “at the wall.” 120 into 138w is 87% efficient. We don’t actually know the system was pulling the full 120w DC. The fanless system obviously cannot dissipate that sustained, but settles in the 50-55w range, 60w at the wall. That’s how modern CPUs work. They idle cold, blow past the normal power budget for load and then settle closer to rated power when things warm up.
  • Oxford Guy - Saturday, September 18, 2021 - link

    Ok. Thanks for the clarification.

    So, it's only a single design failure then (thermal throttling).

    My view of thermal throttling is that it should only happen as a preventative measure to keep a system from being ruined due to user error (such as letting a machine become clogged with dust).

    Otherwise, you're clocking the chip wrong or doing something else wrong with the design. Stuffing 14nm into a passive case in 2021 probably is part of the mistake.

    But, for tricking people with numbers I guess hiding the real performance behind a shifting facade of throttling is fun.
  • Wrs - Sunday, September 19, 2021 - link

    So there is normal throttling and then there is emergency throttling or sometimes shutdown. The CPU is rated for 35w, even though the same silicon is known to be capable of 65 or 95w. What they do is as long as all the temperatures are cool, they let the silicon use 60w+ for a few seconds. This can happen in a laptop, or in this industrial enclosure. It makes it feel just as fast as a desktop, but it can’t last for a heavy sustained workload because of heat buildup. After it warms up, it goes back down to the voltage and frequency it was designed to sustain.

    It has nothing to do with 14nm. My 7nm desktop works similarly. In 2021 Intel’s got 10nm for low-power (that’s what all Tiger Lake laptops are), but OnLogic was too cheap for that or figured their clientele doesn’t want the latest and greatest. Their case successfully prevented the 35w chip from emergency throttling, so it passed the thermal design test in my book.
  • Oxford Guy - Sunday, September 19, 2021 - link

    Marketing magic to try to justify inadequate cooling. Not a fan.
  • Wrs - Monday, September 20, 2021 - link

    I mean, it is a fanless, almost sealed enclosure the size of a standing router or cable modem - how much more can you expect? The benchmarks were more than fine. They way outclassed the Zotac, which is also fanless and the size of a router, but uses commodity plastic hole vents which would be wholly inappropriate in industrial settings but would be suitable as a living room htpc. The OnLogic system gets close to 80c peak on the case; one would hope for the sake of longevity that they used high temperature components throughout and that would be the reason for the high price.

    Potential improvements are obviously a finer process node like Tiger Lake or one of the Zen 3 laptop chips, a low-power specialized fab node... but all that R&D takes time and $$. The world isn't perfect and we don't have infinite population.
  • Oxford Guy - Tuesday, September 21, 2021 - link

    ‘how much more can you expect’

    I expect parts to match the capability of the cooling versus putting too-demanding parts into a box and relying on throttling. If the parts need a larger heatsink box then use that or choose less demanding parts.

    The only exception is turbo that is designed to safely ‘overclock’ a chip if the cooling is better than the norm. That is a good feature.
  • Wrs - Tuesday, September 21, 2021 - link

    As far as I can tell the parts match very well. All the CPU choices for the little box top out at 35w. Obviously the 138w momentary draw came from turbo; there is no separate GPU. The review found the junction temperature under sustained load hit 98C which is just under the throttling temp of 100C. A 15w chip would have undersold the capabilities of the design, and a 65w+ desktop part would have been throttled under sustained load unless perhaps operating out of Antarctica…

    That’s not to say some won’t take issue with the incomplete seal, or that there might be component longevity issues down the road which is where a warranty comes in.
  • Jonny314159 - Friday, September 17, 2021 - link

    Any VRM cooling on this? I think I see a thermal pad for the SSD, but the VRMs will be a long term point of failure running in a sealed box with no conductive path to the heatsink.

Log in

Don't have an account? Sign up now