System Performance: UL and BAPCo Benchmarks

Our 2022 test suite for Windows 11-based systems carries over some of the standard benchmarks we have been using over the last several years, including UL's PCMark and BAPCo's SYSmark. Starting this year, we are also including BAPCo's CrossMark multi-platform benchmarking tool.

PCMark 10

UL's PCMark 10 evaluates computing systems for various usage scenarios (generic / essential tasks such as web browsing and starting up applications, productivity tasks such as editing spreadsheets and documents, gaming, and digital content creation). We benchmarked select PCs with the PCMark 10 Extended profile and recorded the scores for various scenarios. These scores are heavily influenced by the CPU and GPU in the system, though the RAM and storage device also play a part. The power plan was set to Balanced for all the PCs while processing the PCMark 10 benchmark.

Futuremark PCMark 10 - Essentials

Futuremark PCMark 10 - Productivity

Futuremark PCMark 10 - Gaming

Futuremark PCMark 10 - Digital Content Creation

Futuremark PCMark 10 - Extended

The 'Essentials' workload score is dictated by single-threaded burst performance, and the Tiger Lake-U systems take up the top three spots. However, the 'Productivity' and 'Digital Content Creation' workloads seem to appreciate larger number of cores. The octa-core Renoir systems come out on top, and even the hexa-core equipped ASUS PN51-E1 leapfrogs the Tiger Lake-U systems in the 'Productivity' workload. For the 'Gaming' workload, the TGL-U systems with the new Iris Xe iGPU is able to surpass Renoir. The iGPU in the TGL-U Core i7 in the ASRock Industrial NUC BOX-1165G7 enjoys a healthy lead over the competition. Overall, though, the octa-core Renoir-equipped UCFF PCs get a slight edge over the mid-range TGL-U configuration in the NUC11TNBi5. Another key takeaway here is that the scores for the actively-cooled and passively-cooled versions are pretty much similar, lending credence to the possibility of Akasa having pulled off another excellent offering in the Newton TN.

BAPCo SYSmark 25

BAPCo's SYSmark 25 is an application-based benchmark that uses real-world applications to replay usage patterns of business users in the areas of productivity, creativity, and responsiveness. The 'Productivity Scenario' covers office-centric activities including word processing, spreadsheet usage, financial analysis, software development, application installation, file compression, and e-mail management. The 'Creativity Scenario' represents media-centric activities such as digital photo processing, AI and ML for face recognition in photos and videos for the purpose of content creation, etc. The 'Responsiveness Scenario' evaluates the ability of the system to react in a quick manner to user inputs in areas such as application and file launches, web browsing, and multi-tasking.

Scores are meant to be compared against a reference desktop (the SYSmark 25 calibration system, a Lenovo Thinkcenter M720q with a Core i5-8500T and 8GB of DDR4 memory to go with a 256GB M.2 NVMe SSD). The calibration system scores 1000 in each of the scenarios. A score of, say, 2000, would imply that the system under test is twice as fast as the reference system.

SYSmark 25 - Productivity

SYSmark 25 - Creativity

SYSmark 25 - Responsiveness

SYSmark 25 - Overall

SYSmark 25 also adds energy measurement to the mix. A high score in the SYSmark benchmarks might be nice to have, but potential customers also need to determine the balance between power consumption and the performance of the system. For example, in the average office scenario, it might not be worth purchasing a noisy and power-hungry PC just because it ends up with a 2000 score in the SYSmark 25 benchmarks. In order to provide a balanced perspective, SYSmark 25 also allows vendors and decision makers to track the energy consumption during each workload. In the graphs below, we find the total energy consumed by the PC under test for a single iteration of each SYSmark 25 workload. For reference, the calibration system consumes 8.88 Wh for productivity, 10.81 Wh for creativity, and 19.69 Wh overall.

SYSmark 25 - Productivity Energy Consumption

SYSmark 25 - Creativity Energy Consumption

SYSmark 25 - Overall Energy Consumption

The scores for the NUC11TNKi5 and the Akasa Newton TN build are approximately the same (within the realm of run to run variations), and there is a sizable different in the energy consumption in favor of the passive build (probably due to the absence of the fan's power consumption). On the raw scores side, the mid-range TGL-U systems make it to the top half dominated by Core i7 offerings with higher package power budgets.

BAPCo CrossMark 1.0.1.86

BAPCo's CrossMark aims to simplify benchmark processing while still delivering scores that roughly tally with SYSmark. The main advantage is the cross-platform nature of the tool - allowing it to be run on smartphones and tablets as well.

CrossMark 1.0.1.86 - Productivity

CrossMark 1.0.1.86 - Creativity

CrossMark 1.0.1.86 - Responsiveness

CrossMark 1.0.1.86 - Overall

The relative performance seen in SYSmark 25 translate to CrossMark also, as expected. The responsiveness ratings point to the first sign of hiccups for the Akasa Newton TN build. While the SSD has a significant impact on this sub-component score, our monitoring software didn't report any dangerous temperatures for the SSD. As such, we trust SYSmark 25 more than CrossMark because it operates with real workloads and without idle time compression, rather than a simulation of the activity.

Setup Notes and Platform Analysis System Performance: Miscellaneous Workloads
Comments Locked

18 Comments

View All Comments

  • deporter - Friday, July 22, 2022 - link

    Thanks for the review!
    Indeed, if you want to cool that kind of power without any throttling, you simply need a bigger mass of metal. Still, it's not so bad and probably good enough for most use cases.
  • deil - Monday, July 25, 2022 - link

    A little sad its throttling, it's very close to sustaining it while new and clean, it might become choppy and slow soon, when tiny amount of dust will get in. especially in SFF, I prefer machines that don't go beyond 80'C
  • yankeeDDL - Wednesday, July 27, 2022 - link

    I use a laprop with Tiger Lake as my daily driver for work. Company policy is Intel-only.
    It is a hot mess, drains the battery and it is definitely not zippy. I have a 4800HS at home that runs circles around it.
    74W at the wall. And it is half as fast as a 4800U in multithreaded apps. With TL Intel is not even in the same ballpark as AMD. Gen 12 seems a huge improvement. Perhaps Gen 13 will catch up.
  • ganeshts - Wednesday, July 27, 2022 - link

    I am curious from a benchmarking suite perspective - what are the multi-threaded apps that you are using? CPU-based rendering like Cinebench etc., obviously benefits - but no one is seriously going to use a TGL-U system for that purpose. I do see MT performance benefiting compression and decompression using 7-Zip. Anything else?
  • Calin - Thursday, July 28, 2022 - link

    Corporate computers run a _lot_ of software that is not present on home computers. Also, their startup sequence is more complex due to the integration into Active Directory (adding extra startup steps).
    Not to mention that you might have a transparent VPN installed that send data through the company network, which slows down otherwise fast "internet" actions.
    So, you're comparing apples and oranges.
  • TensorVortex - Friday, July 22, 2022 - link

    Yah there are some router on aliexpress with i5 or i7 11th gen fanless that cost the same or cheaper than this. I bought one and was running it at 70C fanless, and a filter cap blown, and the high side mosfet also burnt through… bought new mosfet, contacted support to get the spec of the filter cap, apparently they are using L5V rating caps, no wonder it blowns in a fanless case…. I have replaced the cap with X5R cap, and running a fan to cool it down now…
  • t.s - Friday, July 22, 2022 - link

    For box that small, > 70 watt is insane.
  • Ryan1981 - Saturday, July 23, 2022 - link

    I have an Intel NUC 8 Rugged Kit NUC8CCHKR, I've tried the Zotac CI331 Nano, both fanless but not "noiseless"! I wanted these as a bedroom HTPC that I can leave on in the night for smart home purposes and the convenience of not having to wait till it's booted and ready to go but I ended up having to turn it off because while there is no fan noise, the electrical noise coming from these PC's is audible at night and disrupting my sleep. No major issue for me since it was a test but when I see this article claiming it is noiseless, I strongly suspect it is in fact not, and I'd feel it should be included in the testing. In fact I'd feel this is an underestimated topic to have bedroom appliances like clocks, phone chargers and nowadays smart lights etc. that do not make some form of electrical noise (speficially high pitched ones).
  • ganeshts - Saturday, July 23, 2022 - link

    I have observed the issue in a couple of fanless mini-PCs.. like the one reviewed here:

    https://www.anandtech.com/show/14157/zotac-zbox-ci...

    I had observed this issue in some of the fanless Zotac PCs I had reviewed back in 2016 too. I think the problem actually may vary from sample to sample - I also reviewed the CI662 nano with pretty much the same board, but just a newer CPU - and that didn't have the problem.

    It has probably got to do with some particular board component choice.

    I am surprised about the Chaco Canyon, though. Usually, Intel's board components are top-notch.
  • abufrejoval - Saturday, July 23, 2022 - link

    I got tons of equipment in the room where I also sleep.

    And I remember being bothered by a high pitched noise when things quietened down at night, that was hard to pinpoint. I tried using a spectroscope app on the smartphone to identify where the high pitch was coming from, too. I wound up really ripping out everything connected to the power lines, but no luck.

    Eventually it dawned on me that I have tinnitus...

Log in

Don't have an account? Sign up now