Covid activity assessment - CareEvolution
Introduction
As our experience with the novel coronavirus (SARS-CoV-2) has grown, scientists and clinicians have developed a better understanding of how the disease spreads. Several studies have examined modes of transmission, and epidemiologists have published articles analyzing risk factors inherent in everyday activities. The MyDataHelps digital health platform leverages this information to help users make informed choices about the activities they participate in.
Activity transmission risk
The app focuses on activity-specific risk of viral transmission. For example, is going to the bar riskier than going to the park, all else being equal? How much riskier, and why?
Deliberately excluded are factors specific to the person or the community, including:
- Individual health conditions that might make someone more prone to poor outcomes from viral illness.
- Prevalence of coronavirus within the community.
- Prior exposure to coronavirus, which may convey some degree of immunity for an unknown period of time.
- Use of substances such as alcohol, which may reduce inhibitions and engender riskier behaviors.
- Mask-wearing and other mitigations practices by other participants.
Tools like this can provide people with a much better idea about how much risk is associated with the things that they’re going to do.
Emily Landon,
Epidemiologist
While these factors are important to an individual’s overall risk, conflating them with the activity can undermine the user’s appreciation of activity-based risks. To an individual in a hot spot with a compromised immune system, almost everything might pose significant risk; there is nevertheless value in understanding which activities are riskier than others.
By focusing on activity-specific risk, we empower users. They cannot control whether their community is a hot spot or whether other people will wear masks, but they can control which activities they choose to participate in and be aware of the risks they are taking. According to epidemiologist Emily Landon, tools like this can provide people with, “a much better idea about how much risk is associated with the things that they’re going to do.”
App workflow
The app prompts the user to select an activity, such as going to the bar or grocery shopping, and then displays a risk profile for that activity. This profile includes:
- An overall activity transmission risk score of Low, Medium Low, Medium, High, or Very High.
- A summary of characteristics that influenced the risk score, such as crowd size and location. These factors are discussed in more detail in the following section.
The user can adjust the activity characteristics and see the transmission risk score change in real-time. This helps develop an understanding of how the various conditions impact risk.
Scoring methodology and risk factors
To determine the transmission risk scoring system and activity characteristics, we first reviewed a number of articles in which panels of expert epidemiologists rated the risks of everyday activities, as well as the CDC’s general activity guidance.
Two of the articles, from Michigan and Texas, provided numerical scores for approximately forty different activities. These scores served as our quantitative data for training and validating our scoring algorithm. The numerical analysis is discussed in detail in the following section.
In addition to the quantitative numbers, the experts provided a narrative discussing what made certain activities riskier than others. For example, on stadiums, the Michigan panel stated, “...sports stadiums have crowding and alcohol. People are also likely to cheer, yell and sing, among other noises, which also makes the spread easier.” On indoor restaurants, infectious disease expert Elizabeth Connick said, “I think the biggest risk is being in a closed space and breathing the same air that other people are breathing, and also not wearing masks.”
In reviewing these articles, common themes emerged. The Japanese Ministry of Health based its public information campaign around avoiding the “Three C’s”:
- Closed Spaces (with poor ventilation)
- Crowded Places (with many people nearby)
- Close Contact Settings (such as close-range conversations)
The Michigan panel cited similar factors, stating, “...whether it’s inside or outside; proximity to others; exposure time; likelihood of compliance; and personal risk level.” Dr. William Miller, an epidemiologist at Ohio State University, concurred, “We can think of transmission risk with a simple phrase: time, space, people, place.”
Based on these consistent themes, we selected four characteristics for our activity rankings:
- Location – Indoors venues, especially small ones with poor ventilation, carry a higher risk of exposure than outdoors ones.
- Crowd size – More people means more opportunities for exposure.
- Close contact – Being in close proximity (an absence of social distancing) increases the chance of exposure.
- Duration – The longer the activity, the greater the chance of exposure.
In addition to these four primary characteristics, two special situations were mentioned repeatedly in the articles: respiratory droplets and shared items.
The Michigan panel explained respiratory droplets as, “When people talk loud or sing, it potentially emits more of the virus into the environment, further increasing the risk level.” This conclusion is reinforced by studies examining coronavirus outbreaks in various contexts.
The other special situation involved sharing items. The CDC guidance advises people to consider whether they will need to, “share any items, equipment, or tools with other people.” The Michigan panel emphasized the need to wipe down shared gym equipment before use.
Our app considers activities that involve shared items, shouting, loud talking, singing, exertion, or aerosolizing medical/dental procedures as being at a higher risk than other activities with equivalent primary characteristics.
Taking all these factors into consideration, the app generates an activity-specific risk score from 1 to 9. This score is presented to the user as a descriptive rating according to the following table:
| Risk Score | Risk Title |
|---|---|
| 9 | Very High |
| 7-8 | High |
| 5-6 | Medium |
| 3-4 | Medium Low |
| 1-2 | Low |
Algorithm development
Starting with the forty activities rated by the Michigan and Texas panels, we assigned ratings in each of the four primary characteristics (location, duration, crowd size, and close contact), the two special situations (shared items and respiratory droplets), and the expected risk score (based on the expert ratings).
We then developed approximately twenty of our own activity ratings to add more granular scenarios or to fill in gaps. For example, we split “Air Travel” into multiple scenarios for “short non-stop flight”, “multi-stop layover”, and “international flight.”
A linear regression model was developed, and predictors were assigned to categorical predictors. The assignments used were:
| Predictor | Scoring |
|---|---|
| Close Contact | 1 = Yes No social distancing is performed; participants count as “close contacts” by the CDC definitions (<6 ft; >= 15 minutes) 0 = No Social distancing is performed, or the nature of the activity (e.g., hiking or pumping gas) does not anticipate close contact with anyone outside the household. |
| Crowd Size | 3 = Big Crowd (more than 25 people) 2 = Medium Crowd (11-25 people) 1 = Small Group (5-10 people) 0 = Individuals (less than 5 people) |
| Duration | 2 = Long (More than 2 hours) 1 = Short (1-2 hours) 0 = Quick (Less than 1 hour) |
| Location | 2 = Indoors (Small) 1 = Indoors (Large) 0 = Outdoors |
| Respiratory Droplets | 1 = Yes 0 = No |
| Shared Items | 1 = Yes 0 = No |
The final algorithm had an adjusted R-squared value of 0.910, indicating that the predictors account for the majority of the variance in the model. The P-values for all six predictors are highly significant.
Further validation
The expert scores used to drive the algorithm were all subjective opinions, and no formal studies to date have explored a scoring system for activities such as the one used here. However, data from several sources helps us to validate these ratings.
The activities identified as significant drivers of infection in various reports are also highlighted as “High” or “Very High” risk by our app. Although further study is warranted, this data lends credence to the expert analysis on which our algorithm is based.
Location-based incidence warning
Although community prevalence is excluded from the activity risk assessment numbers, the app does provide a separate, optional assessment of Covid prevalence in the activity location (specified by the user as a postal code).
Conclusions
Our app provides advice about the transmission risk of everyday activities, with high correlation to the ratings given by expert epidemiologists. Although this data is currently highly subjective, it is our hope that ongoing studies and contact tracing metrics will provide additional data to refine the algorithm. Our goal is to provide a tool at the user’s fingertips to help them make good decisions about what activities they engage in, and potentially reduce the spread of COVID-19.