Appearance

Terminology Service ​

System ​

The following system was used for performance evaluation:

SystemProviderCPUCoresRAMSSD
A5N46on-premRyzen 9900X2496 GiB4 TB Samsung 990 Pro

Methods ​

The load testing tool k6 is used to create load from another host as the test system.

ValueSet $validate-code ​

This section shows performance data of ValueSet $validate-code requests by a rising number of concurrent clients. The requests measured are:

GET [base]/ValueSet/$validate-code?url=[url]&system=[system]&code=[code]

The codes were taken from an expansion of the value set. In order to limit the amount of memory each client uses, the codes were further sampled down to about 1000 random codes. The result status of the response was checked to be true.

SNOMED CT ​

The value set http://hl7.org/fhir/ValueSet/body-site contains one is-a filter with concept 442083009 (Anatomical or acquired body structure).

Line chart. SNOMED CT – ValueSet – http://hl7.org/fhir/ValueSet/body-site. Concurrent Clients from 0 to 85. Left axis Requests/s: Requests/s. Right axis Processing Time (ms): Median RT, P95 RT, P99 RT.SNOMED CT – ValueSet – http://hl7.org/fhir/ValueSet/body-site0100002000030000400005000060000700000123456701020304050607080Concurrent Clients 5 · Requests/s: 8517.683Concurrent Clients 10 · Requests/s: 15508.183Concurrent Clients 20 · Requests/s: 26957.3Concurrent Clients 30 · Requests/s: 35787.1Concurrent Clients 40 · Requests/s: 41312.667Concurrent Clients 50 · Requests/s: 46045.417Concurrent Clients 60 · Requests/s: 49114.333Concurrent Clients 70 · Requests/s: 51578.817Concurrent Clients 80 · Requests/s: 52382.15Concurrent Clients 5 · Median RT: 0.539 msConcurrent Clients 10 · Median RT: 0.571 msConcurrent Clients 20 · Median RT: 0.669 msConcurrent Clients 30 · Median RT: 0.761 msConcurrent Clients 40 · Median RT: 0.866 msConcurrent Clients 50 · Median RT: 0.961 msConcurrent Clients 60 · Median RT: 1.069 msConcurrent Clients 70 · Median RT: 1.183 msConcurrent Clients 80 · Median RT: 1.314 msConcurrent Clients 5 · P95 RT: 0.666 msConcurrent Clients 10 · P95 RT: 0.747 msConcurrent Clients 20 · P95 RT: 0.879 msConcurrent Clients 30 · P95 RT: 1.028 msConcurrent Clients 40 · P95 RT: 1.291 msConcurrent Clients 50 · P95 RT: 1.507 msConcurrent Clients 60 · P95 RT: 1.756 msConcurrent Clients 70 · P95 RT: 2.032 msConcurrent Clients 80 · P95 RT: 2.418 msConcurrent Clients 5 · P99 RT: 0.743 msConcurrent Clients 10 · P99 RT: 0.838 msConcurrent Clients 20 · P99 RT: 1.056 msConcurrent Clients 30 · P99 RT: 1.278 msConcurrent Clients 40 · P99 RT: 1.687 msConcurrent Clients 50 · P99 RT: 2.087 msConcurrent Clients 60 · P99 RT: 2.444 msConcurrent Clients 70 · P99 RT: 2.842 msConcurrent Clients 80 · P99 RT: 3.534 msRequests/sProcessing Time (ms)Concurrent ClientsRequests/sMedian RTP95 RTP99 RT

The blue curve shows the requests per second that were achieved by repeating $validate-code requests with a new random code for each request. There is no wait time between requests. The number of requests per second rise nearly linear with the number of concurrent clients up to about 30 clients were the growth declines.

The three orange curves show the processing time, without network effects, as median, 95% and 99% quantile. Especially the 99% quantile shows that the processing time behaves very good with only about 3.5 milli seconds at 80 concurrent clients.

LOINC ​

The value set http://hl7.org/fhir/uv/ips/ValueSet/results-laboratory-observations-uv-ips contains two inclusion filter one with STATUS = ACTIVE, one with CLASSTYPE = 1 and one exclusion filter with CLASS =~ CYTO|HL7\.CYTOGEN|HL7\.GENETICS|^PATH(\..*)?|^MOLPATH(\..*)?|NR STATS|H&P\.HX\.LAB|CHALSKIN|LABORDERS.

Line chart. LOINC – Value Set – ../results-laboratory-observations-uv-ips. Concurrent Clients from 0 to 85. Left axis Requests/s: Requests/s. Right axis Processing Time (ms): Median RT, P95 RT, P99 RT.LOINC – Value Set – ../results-laboratory-observations-uv-ips0100002000030000400005000060000700000123456701020304050607080Concurrent Clients 5 · Requests/s: 9762.017Concurrent Clients 10 · Requests/s: 17844.333Concurrent Clients 20 · Requests/s: 31409.233Concurrent Clients 30 · Requests/s: 42853.517Concurrent Clients 40 · Requests/s: 51112.367Concurrent Clients 50 · Requests/s: 56167.917Concurrent Clients 60 · Requests/s: 60341.483Concurrent Clients 70 · Requests/s: 64657.1Concurrent Clients 80 · Requests/s: 68313.117Concurrent Clients 5 · Median RT: 0.444 msConcurrent Clients 10 · Median RT: 0.518 msConcurrent Clients 20 · Median RT: 0.565 msConcurrent Clients 30 · Median RT: 0.62 msConcurrent Clients 40 · Median RT: 0.677 msConcurrent Clients 50 · Median RT: 0.763 msConcurrent Clients 60 · Median RT: 0.847 msConcurrent Clients 70 · Median RT: 0.911 msConcurrent Clients 80 · Median RT: 0.987 msConcurrent Clients 5 · P95 RT: 0.564 msConcurrent Clients 10 · P95 RT: 0.639 msConcurrent Clients 20 · P95 RT: 0.734 msConcurrent Clients 30 · P95 RT: 0.806 msConcurrent Clients 40 · P95 RT: 0.963 msConcurrent Clients 50 · P95 RT: 1.163 msConcurrent Clients 60 · P95 RT: 1.342 msConcurrent Clients 70 · P95 RT: 1.527 msConcurrent Clients 80 · P95 RT: 1.699 msConcurrent Clients 5 · P99 RT: 0.646 msConcurrent Clients 10 · P99 RT: 0.724 msConcurrent Clients 20 · P99 RT: 0.886 msConcurrent Clients 30 · P99 RT: 1.001 msConcurrent Clients 40 · P99 RT: 1.417 msConcurrent Clients 50 · P99 RT: 1.708 msConcurrent Clients 60 · P99 RT: 1.973 msConcurrent Clients 70 · P99 RT: 2.275 msConcurrent Clients 80 · P99 RT: 2.498 msRequests/sProcessing Time (ms)Concurrent ClientsRequests/sMedian RTP95 RTP99 RT

The performance is a better than with the SNOMED CT value set but overall comparable.

Alpha-ID ​

The value set http://fhir.de/ValueSet/bfarm/alpha-id just includes all concepts from the code system http://fhir.de/CodeSystem/bfarm/alpha-id. The Alpha-ID code system, with its 90399 concepts, is chosen as a representative of a large non-built-in code system.

Line chart. Alpha-ID – Value Set – http://fhir.de/ValueSet/bfarm/alpha-id. Concurrent Clients from 0 to 85. Left axis Requests/s: Requests/s. Right axis Processing Time (ms): Median RT, P95 RT, P99 RT.Alpha-ID – Value Set – http://fhir.de/ValueSet/bfarm/alpha-id0100002000030000400005000060000700000123456701020304050607080Concurrent Clients 5 · Requests/s: 9363.917Concurrent Clients 10 · Requests/s: 16905.1Concurrent Clients 20 · Requests/s: 29752.133Concurrent Clients 30 · Requests/s: 40213.75Concurrent Clients 40 · Requests/s: 47330.6Concurrent Clients 50 · Requests/s: 51964.067Concurrent Clients 60 · Requests/s: 55899.233Concurrent Clients 70 · Requests/s: 58097.267Concurrent Clients 80 · Requests/s: 60579.017Concurrent Clients 5 · Median RT: 0.464 msConcurrent Clients 10 · Median RT: 0.536 msConcurrent Clients 20 · Median RT: 0.602 msConcurrent Clients 30 · Median RT: 0.662 msConcurrent Clients 40 · Median RT: 0.737 msConcurrent Clients 50 · Median RT: 0.824 msConcurrent Clients 60 · Median RT: 0.919 msConcurrent Clients 70 · Median RT: 1.015 msConcurrent Clients 80 · Median RT: 1.099 msConcurrent Clients 5 · P95 RT: 0.588 msConcurrent Clients 10 · P95 RT: 0.667 msConcurrent Clients 20 · P95 RT: 0.775 msConcurrent Clients 30 · P95 RT: 0.875 msConcurrent Clients 40 · P95 RT: 1.072 msConcurrent Clients 50 · P95 RT: 1.299 msConcurrent Clients 60 · P95 RT: 1.506 msConcurrent Clients 70 · P95 RT: 1.789 msConcurrent Clients 80 · P95 RT: 2.039 msConcurrent Clients 5 · P99 RT: 0.672 msConcurrent Clients 10 · P99 RT: 0.76 msConcurrent Clients 20 · P99 RT: 0.928 msConcurrent Clients 30 · P99 RT: 1.113 msConcurrent Clients 40 · P99 RT: 1.478 msConcurrent Clients 50 · P99 RT: 1.888 msConcurrent Clients 60 · P99 RT: 2.165 msConcurrent Clients 70 · P99 RT: 2.657 msConcurrent Clients 80 · P99 RT: 2.995 msRequests/sProcessing Time (ms)Concurrent ClientsRequests/sMedian RTP95 RTP99 RT

The performance is a slightly better than with the SNOMED CT value set but overall comparable.