Academic Medicine Hacks

How is Impact Measured?

A scholar’s impact has traditionally been measured via bibliometrics, which include citation impact scores like h-index and i10-index. These indices quantify the number of times someone’s work was cited by others in established databases, such as Google Scholar.

Two broader forms of evaluating the usage and impact of research have emerged in the past decade as an adjunct to traditional citation metrics:

  1. Article-level metrics (ALMs) provide a wide range of metrics about the uptake of an individual journal article by the scientific community after publication. Starting in 2009, the Public Library of Science (PLoS) introduced ALMs for all articles.
  1. Altmetrics, proposed in 2010 measure the broader impact of a work such as how many data and knowledge bases refer to it, article views, downloads and mentions in news and social media.

Several services calculate ALM and altmetrics statistics, including Plum Analytics , Altmetric and ImpactStory. Depending on your goals for tracking and disseminating your impact, one or more of these services may be best for you.


Track your Impact Metrics

Track Impact Metrics for Your Published Work

Most published work has a DOI—a persistent interoperable identifier—that is in a system indexed by one of the services that calculated ALMs.

  • The subscription form of ImpactStory ($60/year) draws on numerous sources of existing data to compile an overview of your overall impact. The free version draws on your ORCID identifier and Twitter feed to compile a more abbreviated overview of your impact. Here is mine as an example.
  • Altmetric tracks more diverse sources and thus provides more granular data about the context in which your work was cited (who, where, how, when etc.) It provides this information at the publication-level rather than at the scholar-level (like ImpactStory)—a task made easier by the Altmetric bookmarklet. So, for example, here is the Altmetric data for one of my recent publications.
  • Plum Analytics was acquired by Elsevier and seems more oriented towards selling larger research institutions altmetric data related to comparing researchers and institutions.

Track Impact Metrics for Your Unpublished Work

Unpublished work includes diverse bodies of scholarly work including but not limited to

Educational resources: curricula, lecture slide decks, podcasts, outreach, simulation scripts and other educational modalities.

  • Grey literature: this includes online reports not indexed in the National Library of Medicine as well as conference proceedings, quality improvement reports, academic blog posts and other output.
  • Community impact: if work you have done—published or not—has impact on the community, this is not always captured by altmetrics sources. This impact includes media coverage, changes to policy and program implementations or improvements.
  • Tracking impact not connected to a traditional academic URL database requires more creativity. Although each publication has its own PubMed-indexed URL, other academic output does not.

Create unique URLs for each of your web-based outputs. If there is an existing academic sharing repository for these, use it. Some examples are:

  • Medical education materials: MedEdPORTAL
  • Other educational resources and grey literature: I use SlideShare to maintain a URL for each non-PubMed output. This includes materials I make “public” such as lecture slides and posters, as well as materials I share on a more limited basis, such as program description documents.  Two other repositories for sharing scholarly output are:
    • FigShare A repository where users can make all of their research outputs available in a citable, shareable and discoverable manner.
    • Zenodo A repository service that enables researchers, scientists, projects and institutions to share and showcase multidisciplinary research results (data and publications) that are not part of existing institutional or subject-based repositories.

To track your metrics for output on these academic sharing repository sites, you can

  • Follow metrics on the site.
  • Convert each SlideShare URL for each of these outputs into a unique URL that you can track yourself. I use Google URL Shortener because of its great analytics. If you are going this route, use these shortened URLs every timeyou share your content. Follow your use metrics on the Google URL Shortener website.
  • The subscription version of ImpactStory tracks SlideShare and figshare.
  • If something you do cannot be hosted on an academic sharing repository site, host it somewhere (like Google Docs) and use Google analytics to track its usage metrics.
  • On each poster you present at a conference, post the poster on SlideShare and then include a QR code for the poster’s unique URL on the poster itself. There are many free QR code generators online. Here is the QR code of the SlideShare version of a poster: 2BD8FA82-71B1-4CC2-BCD0-0D0786589C1F

Amplify your Reach

Social media and blogging can help disseminate the reach of your work. Much has been written about the downsides of social media, including its association with negative mood, wasted time, loss of privacy and identity theft. If your institution has social media amplification resources—accounts that promote the work of faculty—this is a win-win, as it can amplify your work without the personal risk to you. The downside of this is that the university accounts own your metrics—although you can work around some of this via the “Track your Metrics” hacks above.

If you are on social media, promote your own content (using your unique URLs) and the hashtags that get the most reach in your area. To identify the hashtags that are trending, consider searching the Healthcare Hashtag Project. Conference hashtags like #PAS17 are often promoted by the meeting organizer and are a good way of boosting your reach.

I also recommend this compendium of resources for social media use in academic medicine.

Present your Metrics

In academic medicine, we present the impact of our work both intramurally—in our annual reviews and promotions portfolios—and extramurally, in our NIH Biosketches, personal webpages and other venues.  You can also include a link to the ImpactStory or Altmetric details relevant to your cited impact metrics to support your statements.97DF9312-E28D-4AF7-88AB-F4D0F531FCC7

Networking Sites

There are numerous sites to post an online compilation of your work; many will do some of the work for you.

  • NCBI will import your PubMed-indexed citations into “My Bibliography”, and then generates a sharable URL for this bibliography. It’s also a useful site for storing collections, setting up PubMed searches and managing your SciENcv biosketch generator.
  • Google Scholar also allows you to create a profile including all your publications in the Google Scholar database.
  • ORCID, mentioned above in relation to ImpactStory, compiles your publications and federal grants in one place, and allows you to enter other professional information. It is used by some publication managers as a login ID.
  • ResearchGate allows you to keep up on publications in your field and allows others in academic medicine to follow your output.
  • LinkedIn is not tailored to an academic online CV (hard to import publications, for example), but it is used by so many sectors as a networking resource that it is worth being on, if you don’t mind its association with Microsoft.
  • Doximity was built as a LinkedIn for physicians, and is more compatible with PubMed and some altmetrics. It is only accessible to physicians.
  • Many universities, including mine, host faculty profiles that can be edited by the faculty to some extent. As examples, mine are at:University of Colorado profileColorado Clinical and Translational Sciences Institute profile and Children’s Hospital Colorado profile.

AHCA Medicaid Cuts Would Hit Rural Areas Hardest

According to an analysis conducted by the Georgetown University Center for Children and Families, the Affordable Care Act’s (ACA) Medicaid expansion disproportionately benefited rural Americans over their urban counterparts.  The American Health Care Act’s (AHCA) proposed cuts to Medicaid, rolling it back to below funding levels established by the ACA, would negatively affect millions of kids and adults.

Rural and small town voters–those  often credited with Trump’s 2016 election victory, could stand to lose the most if the president’s health-care overhaul is signed into law. Both nationally and in Colorado, the report found, higher percentages of people in small towns and rural communities are covered by Medicaid than in cities.

Medicaid plays a larger role in providing health coverage to families living in small towns and rural communities than it does in metropolitan areas, a trend that is particularly striking among children. About 45 percent of children in small towns and rural areas rely on Medicaid for their coverage, compared to 38 percent in metro areas. In 14 states, more than half of the children outside of metro areas receive health benefits from Medicaid and the Children’s Health Insurance Program (CHIP). County level urban and rural Medicaid coverage across the US are available on this map:

in Colorado, rural area Medicaid coverage grew 11% with the ACA. 42% of rural kids in CO are covered by #Medicaid.

Impact of AHCA Medicaid Cap on Children

A recent analysis by Avalere projected the impact of federal Medicaid cap proposals on overall and state-by- state federal spending on children currently in Medicaid. The report estimated that the House-passed #AHCA would cut Medicaid for kids by $43 billion by 2026. In Colorado, these cuts would amount to $571 million.

While this study focused exclusively on non-disabled children, the high costs associated with disabled children in Medicaid would likely make the total impact of the AHCA on kids significantly greater.

Fact Check: the Colorado Case for Repeal of the Affordable Care Act (and replacement with the Affordable Health Care Act) is a False Narrative

The Affordable Health Care Act (AHCA or “Trumpcare”) will cut 24 million from insurance by 2026 including 410,600 from Colorado (use this interactive feature to see how many will be impacted in your state).  Colorado’s own Senator Cory Gardner has expressed his reservations about the 14 million projected to lose Medicaid, describing Medicaid as providing “access to life-saving health care services” for the 1.3 million Coloradans—and 72 million Americans—who get their insurance through Medicaid, including the Medicaid expansion part of the Affordable Care Act (ACA). Given the ominous projections about the AHCA’s impact compared to staying with the ACA, how did Republican legislators end up with such a destructive bill after 8 years of decrying the disastrous results of the ACA? The unfortunate reality of what the ACA-to-AHCA transition would mean highlights the accomplishments of the ACA as it is on the verge of elimination: it has improved healthcare access and outcomes for millions of Americans.

The mythology on which the Republican members of congress have based their anti-ACA rhetoric is exemplified by the talking points used by our Colorado legislators. Senator Gardner has reiterated his anti-ACA talking points in his two recent tele-town halls.   As he has before, Senator Gardner gave three arguments for why the ACA must be repealed:

  • Health insurance premiums in Colorado are rising because of the ACA
  • Coloradans lost their health insurance because of the ACA
  • Coloradans can’t access their doctor because of the ACA

Each argument bent the truth, casting the ACA as causing the problem rather than what the data shows it is: part of the solution. If the ACA did not cause the problem, repeal is not the solution.

  • Premiums are rising.  True, but we don’t know how much is due to the ACA and the rise is exaggerated. Premiums were rising before the ACA. This year’s rise brought lower-than-predicted premiums into line with the 2017 rates predicted by the CBO in 2009. The 400% rise cited by Senator Gardner in both tele town halls– of “people whose premium rose from $300 to $1500 a month”—grossly overstates the average rise of 20.4% in Colorado–an increase that primarily impacts those who buy individual policies—about 3% of the population–and is often offset by subsidies.
  • Hundreds of thousands of Coloradans lost insurance: Not true.   By “lost insurance”, the Senator is referring to “churn”—transitioning between plans, sometimes a result of canceled plans—and not about a net loss in insured people in Colorado. The rate of churn was not increased by the ACA. Most cancelations—about 250,000—involved limited benefit plans that were not ACA-compliant, and thus had to be either made ACA-compliant or dropped when the ACA was enacted.  Despite the churn, Colorado has nevertheless seen a net increase of over 530,000 in the number insured. In fact, Coloradans continue to enroll in plans in record-breaking numbers, with a 12% increase seen over the same time last year in the 2017 open enrollment period.
  • People can’t see their doctors because of high deductibles. Not true.  The 2015 Colorado Health Access Survey shows that, since the ACA was passed, increased coverage has meant increased access. Coloradans have steadily increased their rate of preventive health visits by 7% (from 61.9% in 2013 to 66.1% in 2015) and have lowered their rate of skipping doctors’ visits due to costs by 15% (from 12.3% in 2013 to 10.4% in 2015).

Although rising premiums, churn and barriers to accessing doctors were not eradicated by the ACA, this review of Colorado data shows that the ACA is part of the solution, not part of the problem. To do what is best for Coloradans, Senator Gardner needs to step away from his false narrative about the ACA and address real issues reflected in Colorado data.  He has taken a first step in raising concerns about threats to Medicaid. There are ways to strengthen the ACA to address some of the real issues in healthcare, but to repeal it based on a false narrative disseminated by Senator Gardner and his Republican colleagues would be a tragedy.  Let’s look at the facts, and work together to make the system better, for Colorado and the rest of America.



Trump’s budget: a limerick on academic funding cuts

DT’s budget proposal shows defiance

On the value of humanities, art and science.

It defunds NEH,

EPA and NIH,

But academe’s reply won’t be silence!

CBO report on the AHCA: 24 million will lose coverage

The nonpartisan Congressional Budget Office has released their report on the GOP’s Affordable Care Act (ACA) replacement plan. The numbers released in this report are grim, and will only make it more difficult for Republicans to explain why their legislation will outperform the ACA.The bottom line is that 14 million will lose coverage under this plan in 2018, rising to 21 million in 2020 and 24 million in 2026. In the non group market, premiums will rise 15-20% in 2018 and 2019.

The Affordable Care Act is Good for Colorado (and Repeal is Not)

The effects of the Affordable Care Act of 2010 in each state depend on various factors, such as the number of uninsured individuals in the state and the governor’s receptiveness to the law’s provisions. In this post, I focus on the benefits of the Affordable Care Act (ACA) in Colorado, primarily from the perspective of my job as an emergency department (ED) physician, in support of my argument that the ACA must not be repealed–instead, I recommend that it be strengthened. In a prior post, I summarized estimates of the impact of the GOP’s proposed ACA repeal/replace plans on coverage and consumer costs.

Effects of the ACA on Uninsurance Rate in Colorado

In Colorado, the number of uninsured individuals declined by 25.5%, from 729,000 individuals in 2013, or 14.1% of the population, to 543,000 individuals in 2014, or 10.3% of the population. colorado-uninsurance-rate

Colorado was one of 32 states (including DC) that had expanded Medicaid as of 1/1/2017. In fiscal year 2014, annual Medicaid enrollment in Colorado increased by 26.1%. Average monthly enrollment increased 59% from 783,420 to 1,244,031 pre-ACA to post-ACA.

Drivers of Healthcare Cost and Utilization from the Emergency Department Perspective

Healthcare access and coverage–so improved under the ACA–drive a lot of what happens in the emergency department (ED). We can think of this in 3 categories:

  1. How the ACA has impacted who comes into the ED (and the hospital).
  2. How the ACA has decreased the amount of services we ED physicians provide to patients while they are in the ED (and hence the cost).
  3. How the ACA has impacted what happens at the end of the ED visit (should I stay or should I go?)


How the ACA has impacted who comes into the ED (and the hospital)

In Colorado, the number of ED visits has declined with ACA implementation. This varies state, by state, but in Colorado, we have seen a clear decline in the rate of ED visits per insured person–a trend driven by the expansion of Medicaid insurance.


The trend is also apparent when we restrict the analysis to children only:decline-ed-visits-children-co

(This and other data are available from the Colorado All Payer Claims Data summary tools, at Colorado Medical Price Compare, available at )

The decline in population rate of ED visits among Medicaid patients did not result in a net decline in the number of ED visits–in 2014, the overall number of Medicaid ED visits went up, largely because more patients were on Medicaid. But, among those on Medicaid, during the ACA rollout, population rates of ED visits went down. As expected, the number of un-insured ED visits declined in Colorado as the number of Medicaid visits rose.


Increasingly, patients are more likely to visit their medical home (primary care provider) because they are more likely to have one, thanks to the ACA.  When we do see patients in the ED, patients are more likely to have had started treatment before coming in (saw or called their medical home). Diverting more ED visits to the medical home is good for many reasons, not the least of which is cost. cost-ed-vs-pcp

The decline in ED visits is also a Colorado Medicaid performance metric for Colorado’s seven Regional Care Collaborative Organizations (RCCOs)–RCCOs received payment incentives if they achieved a 3% decline in ED visits per patient in their RCCO. Although most RCCOs did not achieve this decline, all achieved some decline in 2016:rcco-level-ed-visit-reduction-medicaid

How the ACA has decreased the amount of services we ED physicians provide to patients while they are in the ED (and hence the cost)

If we know a patient in the ED has no coverage (no financial access to primary care), the ED visit costs more for many reasons, including:

  • The patient is more likely to have tests done in the ED because there is no primary care provider to order tests and follow test results
  • The patient is more likely to have subspecialty consultations instead of office follow-up visits with primary care providers
  • The patient is more likely to get more conservative (more aggressive) treatment in the ED, rather than waiting a day or two to see if the patient really needs more aggressive testing/treatment, because there is no medical home to provide that testing/treatment in a day or two.


How the ACA has impacted what happens at the end of the ED visit

If we, as ED physicians, know a patient has financial access to primary care, we are more likely to discharge them home rather than admit them to the hospital. This is reflected in the decrease in hospital admissions relative to the rate of ED visits among all ages:


The same trend is seen among children only:decline-ed-admit-rate-children-co

As an example of how this works, one of the most common reasons young children are admitted to the hospital in Colorado (and nationwide) is for a common lower respiratory viral syndrome called bronchiolitis. Several of my colleagues at Children’s Hospital of Colorado have performed the research (here and here) to show the circumstances under which a child is safely discharged home on home-oxygen therapy. This is cost-saving in that hospitalizations are expensive, and also result in many missed days of work for parents. The criteria for discharge to home (rather than hospital admission) in our hospital’s evidence based guideline include access (within 24 hours) to a medical home for a follow up check:


Before the ACA permitted so many more access to a medical home, patients with common conditions like bronchiolitis were more likely to be admitted. Discharging more to home means fewer inpatient stays:


Thus, for Colorado consumers, the ACA has helped improve coverage, thereby reducing the per-insured rate of ED visits, the per-ED-visit rate of inpatient admissions and the overall rate of inpatient admissions, both for adults and children. It has primarily done this by allowing more Coloradans to access care where they should be able to: in a medical home. By reducing these costly forms of healthcare utilization, EDs are less crowded for those who truly need ED care. By reducing the proportion of uninsured visitors to the ED and hospital, the ACA has also decreased the amount of uncompensated care, permitting more hospitals to remain in business.

%d bloggers like this: