How to conduct AMR analysis

Matthijs S. Berends

20 December 2019

Note: values on this page will change with every website update since they are based on randomly created values and the page was written in R Markdown. However, the methodology remains unchanged. This page was generated on 20 December 2019.

Introduction

Conducting antimicrobial resistance analysis unfortunately requires in-depth knowledge from different scientific fields, which makes it hard to do right. At least, it requires:

  • Good questions (always start with these!)
  • A thorough understanding of both (clinical) epidemiology and (clinical) microbiology, to understand the clinical and epidemiological relevance of results and their pharmaceutical implications
  • Experience with data analysis with microbiological tests and their results (MIC/RSI values)
  • Availability of the biological taxonomy of microorganisms
  • Available (inter-)national guidelines and methods to apply them

Of course, we cannot instantly provide you with knowledge and experience. But with this AMR pacakge, we aimed at providing (1) tools to simplify antimicrobial resistance data cleaning/analysis, (2) methods to easily incorporate international guidelines and (3) scientifically reliable reference data. The AMR package enables standardised and reproducible antimicrobial resistance analyses, including the application of evidence-based rules, determination of first isolates, translation of various codes for microorganisms and antimicrobial agents, determination of (multi-drug) resistant microorganisms, and calculation of antimicrobial resistance, prevalence and future trends.

Preparation

For this tutorial, we will create fake demonstration data to work with.

You can skip to Cleaning the data if you already have your own data ready. If you start your analysis, try to make the structure of your data generally look like this:

date patient_id mo AMX CIP
2019-12-20 abcd Escherichia coli S S
2019-12-20 abcd Escherichia coli S R
2019-12-20 efgh Escherichia coli R S

Needed R packages

As with many uses in R, we need some additional packages for AMR analysis. Our package works closely together with the tidyverse packages dplyr and ggplot2 by Dr Hadley Wickham. The tidyverse tremendously improves the way we conduct data science - it allows for a very natural way of writing syntaxes and creating beautiful plots in R.

Our AMR package depends on these packages and even extends their use and functions.

Creation of data

We will create some fake example data to use for analysis. For antimicrobial resistance analysis, we need at least: a patient ID, name or code of a microorganism, a date and antimicrobial results (an antibiogram). It could also include a specimen type (e.g. to filter on blood or urine), the ward type (e.g. to filter on ICUs).

With additional columns (like a hospital name, the patients gender of even [well-defined] clinical properties) you can do a comparative analysis, as this tutorial will demonstrate too.

Patients

To start with patients, we need a unique list of patients.

patients <- unlist(lapply(LETTERS, paste0, 1:10))

The LETTERS object is available in R - it’s a vector with 26 characters: A to Z. The patients object we just created is now a vector of length 260, with values (patient IDs) varying from A1 to Z10. Now we we also set the gender of our patients, by putting the ID and the gender in a table:

patients_table <- data.frame(patient_id = patients,
                             gender = c(rep("M", 135),
                                        rep("F", 125)))

The first 135 patient IDs are now male, the other 125 are female.

Dates

Let’s pretend that our data consists of blood cultures isolates from between 1 January 2010 and 1 January 2018.

dates <- seq(as.Date("2010-01-01"), as.Date("2018-01-01"), by = "day")

This dates object now contains all days in our date range.

Microorganisms

For this tutorial, we will uses four different microorganisms: Escherichia coli, Staphylococcus aureus, Streptococcus pneumoniae, and Klebsiella pneumoniae:

bacteria <- c("Escherichia coli", "Staphylococcus aureus",
              "Streptococcus pneumoniae", "Klebsiella pneumoniae")

Other variables

For completeness, we can also add the hospital where the patients was admitted and we need to define valid antibmicrobial results for our randomisation:

hospitals <- c("Hospital A", "Hospital B", "Hospital C", "Hospital D")
ab_interpretations <- c("S", "I", "R")

Put everything together

Using the sample() function, we can randomly select items from all objects we defined earlier. To let our fake data reflect reality a bit, we will also approximately define the probabilities of bacteria and the antibiotic results with the prob parameter.

sample_size <- 20000
data <- data.frame(date = sample(dates, size = sample_size, replace = TRUE),
                   patient_id = sample(patients, size = sample_size, replace = TRUE),
                   hospital = sample(hospitals, size = sample_size, replace = TRUE,
                                     prob = c(0.30, 0.35, 0.15, 0.20)),
                   bacteria = sample(bacteria, size = sample_size, replace = TRUE,
                                     prob = c(0.50, 0.25, 0.15, 0.10)),
                   AMX = sample(ab_interpretations, size = sample_size, replace = TRUE,
                                 prob = c(0.60, 0.05, 0.35)),
                   AMC = sample(ab_interpretations, size = sample_size, replace = TRUE,
                                 prob = c(0.75, 0.10, 0.15)),
                   CIP = sample(ab_interpretations, size = sample_size, replace = TRUE,
                                 prob = c(0.80, 0.00, 0.20)),
                   GEN = sample(ab_interpretations, size = sample_size, replace = TRUE,
                                 prob = c(0.92, 0.00, 0.08)))

Using the left_join() function from the dplyr package, we can ‘map’ the gender to the patient ID using the patients_table object we created earlier:

The resulting data set contains 20,000 blood culture isolates. With the head() function we can preview the first 6 values of this data set:

head(data)
date patient_id hospital bacteria AMX AMC CIP GEN gender
2015-01-13 Y8 Hospital D Escherichia coli S S S S F
2010-04-08 O8 Hospital B Escherichia coli S S S S F
2010-05-11 W2 Hospital A Escherichia coli R S S R F
2011-11-23 I9 Hospital C Klebsiella pneumoniae R S S S M
2011-03-28 D3 Hospital B Escherichia coli S S S S M
2013-11-16 P8 Hospital D Streptococcus pneumoniae R R S S F

Now, let’s start the cleaning and the analysis!

Cleaning the data

We also created a package dedicated to data cleaning and checking, called the cleaner package. It gets automatically installed with the AMR package. For its freq() function to create frequency tables, you don’t even need to load it yourself as it is available through the AMR package as well.

For example, for the gender variable:

data %>% freq(gender) # this would be the same: freq(data$gender)
# Frequency table 
# 
# Class:   factor (numeric)
# Length:  20,000 (of which NA: 0 = 0%)
# Levels:  2: F, M
# Unique:  2
# 
#      Item     Count   Percent   Cum. Count   Cum. Percent
# ---  -----  -------  --------  -----------  -------------
# 1    M       10,341    51.71%       10,341         51.71%
# 2    F        9,659    48.30%       20,000        100.00%

So, we can draw at least two conclusions immediately. From a data scientists perspective, the data looks clean: only values M and F. From a researchers perspective: there are slightly more men. Nothing we didn’t already know.

The data is already quite clean, but we still need to transform some variables. The bacteria column now consists of text, and we want to add more variables based on microbial IDs later on. So, we will transform this column to valid IDs. The mutate() function of the dplyr package makes this really easy:

data <- data %>%
  mutate(bacteria = as.mo(bacteria))

We also want to transform the antibiotics, because in real life data we don’t know if they are really clean. The as.rsi() function ensures reliability and reproducibility in these kind of variables. The mutate_at() will run the as.rsi() function on defined variables:

Finally, we will apply EUCAST rules on our antimicrobial results. In Europe, most medical microbiological laboratories already apply these rules. Our package features their latest insights on intrinsic resistance and exceptional phenotypes. Moreover, the eucast_rules() function can also apply additional rules, like forcing ampicillin = R when amoxicillin/clavulanic acid = R.

Because the amoxicillin (column AMX) and amoxicillin/clavulanic acid (column AMC) in our data were generated randomly, some rows will undoubtedly contain AMX = S and AMC = R, which is technically impossible. The eucast_rules() fixes this:

data <- eucast_rules(data, col_mo = "bacteria")
# 
# Other rules by this AMR package
# Non-EUCAST: inherit amoxicillin results for unavailable ampicillin (no changes)
# Non-EUCAST: inherit ampicillin results for unavailable amoxicillin (no changes)
# Non-EUCAST: set amoxicillin/clav acid = S where ampicillin = S (2,942 values changed)
# Non-EUCAST: set ampicillin = R where amoxicillin/clav acid = R (159 values changed)
# Non-EUCAST: set piperacillin = R where piperacillin/tazobactam = R (no changes)
# Non-EUCAST: set piperacillin/tazobactam = S where piperacillin = S (no changes)
# Non-EUCAST: set trimethoprim = R where trimethoprim/sulfa = R (no changes)
# Non-EUCAST: set trimethoprim/sulfa = S where trimethoprim = S (no changes)
# 
# ----
# Rules by the European Committee on Antimicrobial Susceptibility Testing (EUCAST)
# http://eucast.org/
# 
# EUCAST Clinical Breakpoints (v9.0, 2019)
# Aerococcus sanguinicola (no changes)
# Aerococcus urinae (no changes)
# Anaerobic Gram-negatives (no changes)
# Anaerobic Gram-positives (no changes)
# Campylobacter coli (no changes)
# Campylobacter jejuni (no changes)
# Enterobacterales (Order) (no changes)
# Enterococcus (no changes)
# Haemophilus influenzae (no changes)
# Kingella kingae (no changes)
# Moraxella catarrhalis (no changes)
# Pasteurella multocida (no changes)
# Staphylococcus (no changes)
# Streptococcus groups A, B, C, G (no changes)
# Streptococcus pneumoniae (942 values changed)
# Viridans group streptococci (no changes)
# 
# EUCAST Expert Rules, Intrinsic Resistance and Exceptional Phenotypes (v3.1, 2016)
# Table 01: Intrinsic resistance in Enterobacteriaceae (1,222 values changed)
# Table 02: Intrinsic resistance in non-fermentative Gram-negative bacteria (no changes)
# Table 03: Intrinsic resistance in other Gram-negative bacteria (no changes)
# Table 04: Intrinsic resistance in Gram-positive bacteria (2,709 values changed)
# Table 08: Interpretive rules for B-lactam agents and Gram-positive cocci (no changes)
# Table 09: Interpretive rules for B-lactam agents and Gram-negative rods (no changes)
# Table 11: Interpretive rules for macrolides, lincosamides, and streptogramins (no changes)
# Table 12: Interpretive rules for aminoglycosides (no changes)
# Table 13: Interpretive rules for quinolones (no changes)
# 
# -------------------------------------------------------------------------------
# EUCAST rules affected 6,398 out of 20,000 rows, making a total of 7,974 edits
# => added 0 test results
# 
# => changed 7,974 test results
#    - 95 test results changed from S to I
#    - 4,603 test results changed from S to R
#    - 1,165 test results changed from I to S
#    - 334 test results changed from I to R
#    - 1,777 test results changed from R to S
# -------------------------------------------------------------------------------
# 
# Use eucast_rules(..., verbose = TRUE) (on your original data) to get a data.frame with all specified edits instead.

Adding new variables

Now that we have the microbial ID, we can add some taxonomic properties:

First isolates

We also need to know which isolates we can actually use for analysis.

To conduct an analysis of antimicrobial resistance, you must only include the first isolate of every patient per episode (Hindler et al., Clin Infect Dis. 2007). If you would not do this, you could easily get an overestimate or underestimate of the resistance of an antibiotic. Imagine that a patient was admitted with an MRSA and that it was found in 5 different blood cultures the following weeks (yes, some countries like the Netherlands have these blood drawing policies). The resistance percentage of oxacillin of all isolates would be overestimated, because you included this MRSA more than once. It would clearly be selection bias.

The Clinical and Laboratory Standards Institute (CLSI) appoints this as follows:

(…) When preparing a cumulative antibiogram to guide clinical decisions about empirical antimicrobial therapy of initial infections, only the first isolate of a given species per patient, per analysis period (eg, one year) should be included, irrespective of body site, antimicrobial susceptibility profile, or other phenotypical characteristics (eg, biotype). The first isolate is easily identified, and cumulative antimicrobial susceptibility test data prepared using the first isolate are generally comparable to cumulative antimicrobial susceptibility test data calculated by other methods, providing duplicate isolates are excluded.
M39-A4 Analysis and Presentation of Cumulative Antimicrobial Susceptibility Test Data, 4th Edition. CLSI, 2014. Chapter 6.4

This AMR package includes this methodology with the first_isolate() function. It adopts the episode of a year (can be changed by user) and it starts counting days after every selected isolate. This new variable can easily be added to our data:

So only 28.2% is suitable for resistance analysis! We can now filter on it with the filter() function, also from the dplyr package:

For future use, the above two syntaxes can be shortened with the filter_first_isolate() function:

First weighted isolates

We made a slight twist to the CLSI algorithm, to take into account the antimicrobial susceptibility profile. Have a look at all isolates of patient T5, sorted on date:

isolate date patient_id bacteria AMX AMC CIP GEN first
1 2010-02-25 T5 B_ESCHR_COLI S S S S TRUE
2 2010-03-02 T5 B_ESCHR_COLI R I S S FALSE
3 2010-04-02 T5 B_ESCHR_COLI S S S S FALSE
4 2010-06-08 T5 B_ESCHR_COLI S S S S FALSE
5 2010-06-20 T5 B_ESCHR_COLI S S S S FALSE
6 2010-09-13 T5 B_ESCHR_COLI S S R S FALSE
7 2010-10-06 T5 B_ESCHR_COLI R S S S FALSE
8 2010-11-19 T5 B_ESCHR_COLI S S S S FALSE
9 2010-12-06 T5 B_ESCHR_COLI S S S S FALSE
10 2010-12-07 T5 B_ESCHR_COLI S S R S FALSE

Only 1 isolates are marked as ‘first’ according to CLSI guideline. But when reviewing the antibiogram, it is obvious that some isolates are absolutely different strains and should be included too. This is why we weigh isolates, based on their antibiogram. The key_antibiotics() function adds a vector with 18 key antibiotics: 6 broad spectrum ones, 6 small spectrum for Gram negatives and 6 small spectrum for Gram positives. These can be defined by the user.

If a column exists with a name like ‘key(…)ab’ the first_isolate() function will automatically use it and determine the first weighted isolates. Mind the NOTEs in below output:

isolate date patient_id bacteria AMX AMC CIP GEN first first_weighted
1 2010-02-25 T5 B_ESCHR_COLI S S S S TRUE TRUE
2 2010-03-02 T5 B_ESCHR_COLI R I S S FALSE TRUE
3 2010-04-02 T5 B_ESCHR_COLI S S S S FALSE TRUE
4 2010-06-08 T5 B_ESCHR_COLI S S S S FALSE FALSE
5 2010-06-20 T5 B_ESCHR_COLI S S S S FALSE FALSE
6 2010-09-13 T5 B_ESCHR_COLI S S R S FALSE TRUE
7 2010-10-06 T5 B_ESCHR_COLI R S S S FALSE TRUE
8 2010-11-19 T5 B_ESCHR_COLI S S S S FALSE TRUE
9 2010-12-06 T5 B_ESCHR_COLI S S S S FALSE FALSE
10 2010-12-07 T5 B_ESCHR_COLI S S R S FALSE TRUE

Instead of 1, now 7 isolates are flagged. In total, 75.3% of all isolates are marked ‘first weighted’ - 47.0% more than when using the CLSI guideline. In real life, this novel algorithm will yield 5-10% more isolates than the classic CLSI guideline.

As with filter_first_isolate(), there’s a shortcut for this new algorithm too:

So we end up with 15,050 isolates for analysis.

We can remove unneeded columns:

Now our data looks like:

head(data_1st)
date patient_id hospital bacteria AMX AMC CIP GEN gender gramstain genus species first_weighted
2 2010-04-08 O8 Hospital B B_ESCHR_COLI S S S S F Gram-negative Escherichia coli TRUE
3 2010-05-11 W2 Hospital A B_ESCHR_COLI R S S R F Gram-negative Escherichia coli TRUE
4 2011-11-23 I9 Hospital C B_KLBSL_PNMN R S S S M Gram-negative Klebsiella pneumoniae TRUE
5 2011-03-28 D3 Hospital B B_ESCHR_COLI S S S S M Gram-negative Escherichia coli TRUE
6 2013-11-16 P8 Hospital D B_STRPT_PNMN R R S R F Gram-positive Streptococcus pneumoniae TRUE
7 2014-12-19 Q5 Hospital B B_ESCHR_COLI S S S S F Gram-negative Escherichia coli TRUE

Time for the analysis!

Analysing the data

You might want to start by getting an idea of how the data is distributed. It’s an important start, because it also decides how you will continue your analysis. Although this package contains a convenient function to make frequency tables, exploratory data analysis (EDA) is not the primary scope of this package. Use a package like DataExplorer for that, or read the free online book Exploratory Data Analysis with R by Roger D. Peng.

Dispersion of species

To just get an idea how the species are distributed, create a frequency table with our freq() function. We created the genus and species column earlier based on the microbial ID. With paste(), we can concatenate them together.

The freq() function can be used like the base R language was intended:

freq(paste(data_1st$genus, data_1st$species))

Or can be used like the dplyr way, which is easier readable:

data_1st %>% freq(genus, species)

Frequency table

Class: character
Length: 15,050 (of which NA: 0 = 0%)
Unique: 4

Shortest: 16
Longest: 24

Item Count Percent Cum. Count Cum. Percent
1 Escherichia coli 7,510 49.90% 7,510 49.90%
2 Staphylococcus aureus 3,786 25.16% 11,296 75.06%
3 Streptococcus pneumoniae 2,294 15.24% 13,590 90.30%
4 Klebsiella pneumoniae 1,460 9.70% 15,050 100.00%

Resistance percentages

The functions resistance() and susceptibility() can be used to calculate antimicrobial resistance or susceptibility. For more specific analyses, the functions proportion_S(), proportion_SI(), proportion_I(), proportion_IR() and proportion_R() can be used to determine the proportion of a specific antimicrobial outcome.

As per the EUCAST guideline of 2019, we calculate resistance as the proportion of R (proportion_R(), equal to resistance()) and susceptibility as the proportion of S and I (proportion_SI(), equal to susceptibility()). These functions can be used on their own:

Or can be used in conjuction with group_by() and summarise(), both from the dplyr package:

data_1st %>% 
  group_by(hospital) %>% 
  summarise(amoxicillin = resistance(AMX))
hospital amoxicillin
Hospital A 0.4637522
Hospital B 0.4602655
Hospital C 0.4760000
Hospital D 0.4536218

Of course it would be very convenient to know the number of isolates responsible for the percentages. For that purpose the n_rsi() can be used, which works exactly like n_distinct() from the dplyr package. It counts all isolates available for every group (i.e. values S, I or R):

data_1st %>% 
  group_by(hospital) %>% 
  summarise(amoxicillin = resistance(AMX),
            available = n_rsi(AMX))
hospital amoxicillin available
Hospital A 0.4637522 4552
Hospital B 0.4602655 5197
Hospital C 0.4760000 2250
Hospital D 0.4536218 3051

These functions can also be used to get the proportion of multiple antibiotics, to calculate empiric susceptibility of combination therapies very easily:

genus amoxiclav gentamicin amoxiclav_genta
Escherichia 0.9227696 0.8909454 0.9920107
Klebsiella 0.9191781 0.9061644 0.9917808
Staphylococcus 0.9186476 0.9199683 0.9915478
Streptococcus 0.6129032 0.0000000 0.6129032

To make a transition to the next part, let’s see how this difference could be plotted:

Plots

To show results in plots, most R users would nowadays use the ggplot2 package. This package lets you create plots in layers. You can read more about it on their website. A quick example would look like these syntaxes:

The AMR package contains functions to extend this ggplot2 package, for example geom_rsi(). It automatically transforms data with count_df() or proportion_df() and show results in stacked bars. Its simplest and shortest example:

ggplot(data_1st) +
  geom_rsi(translate_ab = FALSE)

Omit the translate_ab = FALSE to have the antibiotic codes (AMX, AMC, CIP, GEN) translated to official WHO names (amoxicillin, amoxicillin/clavulanic acid, ciprofloxacin, gentamicin).

If we group on e.g. the genus column and add some additional functions from our package, we can create this:

To simplify this, we also created the ggplot_rsi() function, which combines almost all above functions:

Independence test

The next example uses the example_isolates data set. This is a data set included with this package and contains 2,000 microbial isolates with their full antibiograms. It reflects reality and can be used to practice AMR analysis.

We will compare the resistance to fosfomycin (column FOS) in hospital A and D. The input for the fisher.test() can be retrieved with a transformation like this:

# use package 'tidyr' to pivot data; 
# it gets installed with this 'AMR' package
library(tidyr)

check_FOS <- example_isolates %>%
  filter(hospital_id %in% c("A", "D")) %>% # filter on only hospitals A and D
  select(hospital_id, FOS) %>%             # select the hospitals and fosfomycin
  group_by(hospital_id) %>%                # group on the hospitals
  count_df(combine_SI = TRUE) %>%          # count all isolates per group (hospital_id)
  pivot_wider(names_from = hospital_id,    # transform output so A and D are columns
              values_from = value) %>%     
  select(A, D) %>%                         # and only select these columns
  as.matrix()                              # transform to a good old matrix for fisher.test()

check_FOS
#       A  D
# [1,] 25 77
# [2,] 24 33

We can apply the test now with:

As can be seen, the p value is 0.031, which means that the fosfomycin resistance found in hospital A and D are really different.