A.I. &amp; Innovation - Costello

Costello Research Careers

Costello Research Recruiting

Costello Research Evaluating Performance

Costello Research Teams

Accounting Faculty Research

Nonprofits are in trouble. Could more sensitive chatbots be the answer?

Jennifer Anzaldi — Tue, 18 Mar 2025 14:48:25 +0000

Nonprofits are in trouble. Could more sensitive chatbots be the answer? Jennifer Anzaldi Tue, 03/18/2025 - 10:48

In today’s attention economy, impact-driven organizations are arguably at a disadvantage. Since they have no tangible product to sell, the core of their appeal is emotional rather than practical—the “warm glow” of contributing to a cause you care about. But emotional appeals call for more delicacy and precision than standardized marketing tools, such as mass email campaigns, can sustain. Emotional states vary from person to person—even from moment to moment within the same person.

Photo by Getty Images

Siddharth Bhattacharya and Pallab Sanyal, professors of information systems and operations management at the Donald G. Costello College of Business at �鶹��Ƶ, believe that artificial intelligence (AI) can help solve this problem. A well-designed chatbot could be programmed to calibrate persuasive appeals in real time, delivering messaging more likely to motivate someone to take a desired next step, whether that’s donating money, volunteering time or simply pledging support. Automated solutions, such as chatbots, can be especially rewarding for nonprofits, which tend to be cash-conscious and resource-constrained.

“We completed a project in Minneapolis and are working with other organizations, in Boston, New Jersey and elsewhere, but the focus is always the same,” Sanyal says. “How can we leverage AI to enhance efficiency, reduce costs, and improve service quality in nonprofit organizations?”

Siddarth Bhattacharya. Photo provided

Sanyal and Bhattacharya’s working paper (coauthored by Scott Schanke of University of Wisconsin Milwaukee) describes their recent randomized field experiment with a Minneapolis-based women’s health organization. The researchers designed a custom chatbot to interact with prospective patrons through the organization’s Facebook Messenger app. The bot was programmed to adjust, at random, its responses to be more or less emotional, as well as more or less anthropomorphic (human-like).

“For the anthropomorphic condition, we introduced visual cues such as typing bubbles and slightly delayed response to mimic the experience of messaging with another human,” Sanyal says.

The chatbot’s “emotional” mode featured more subjective, generalizing statements with liberal use of provocative words such as “unfair,” “discrimination” and “unjust.” The “informational” modes leaned more heavily on facts and statistics.

Over the course of hundreds of real Facebook interactions, the moderately emotional chatbot achieved deepest user engagement, as defined by a completed conversation. (Completion rate was critical because after the last interaction, users were redirected to a contact/donation form.) But when the emotional level went from moderate to extreme, more users bailed out on the interaction.

The takeaway may be that “there is a sweet spot where some emotion is important, but beyond that emotions can be bad,” as Bhattacharya explains.

Pallab Sanyal. Photo provided

When human-like features were layered on top of emotionalism, that sweet spot got even smaller. Anthropomorphism lowered completion rates and reduced the organization’s ability to use emotional engagement as a motivational tool.

“In the retail space, studies have shown anthropomorphism to be useful,” Bhattacharya says. “But in a nonprofit context, it’s totally empathy-driven and less transactional. If that is the case, maybe these human cues coming from a bot make people feel creepy, and they back off.”

Sanyal and Bhattacharya say that more customized-chatbot experiments with other nonprofits are in the works. They are taking into careful consideration the success metrics and unique needs of each partner organization.

“Most of the time, we researchers sit in our offices and work on these problems,” Sanyal says. “But one aspect of these projects that I really like is that we are learning so much from talking to these people.”

In collaboration with the organizations concerned, they are designing chatbots that can cater their persuasive appeals more closely to each context and individual interlocutor. If successful, this method would prove that chatbots could become more than a second-best substitute for a salaried human being. They could serve as interactive workshops for crafting and refining an organization’s messaging to a much more granular level than previously possible.

And this would improve the effectiveness of organizational outreach across the board—a consummate example of AI enhancing, rather than displacing, human labor. “This AI is augmenting human functions,” says Sanyal. “It’s not replacing. Sometimes it’s complementing, sometimes it’s supplementing. But at the end of the day, it is just augmenting.”

In This Story

Siddharth Bhattacharya

Pallab Sanyal

Topics

Costello Research Artificial Intelligence

Costello Research Machine Learning

Artificial Intelligence

Costello College of Business health care research puts “patients at the center”

Jennifer Anzaldi — Tue, 11 Mar 2025 15:55:18 +0000

Costello College of Business health care research puts “patients at the center” Jennifer Anzaldi Tue, 03/11/2025 - 11:55

In This Story

Nirup Menon

Like virtually every other industry, health care is increasingly prioritizing digital transformation. The sector is unique, however, in that its results are measured not only in business terms but also tangible outcomes for people—often, literal life and death. So are newly acquired technologies actually paying off for patients?

Nirup Menon, a professor of information systems at the Donald G. Costello College of Business at �鶹��Ƶ, says that the answer is “not always.”

Nirup Menon

His recently published paper in Decision Support Systems tackles the so-called “HIT paradox,” or the widespread perception that health information technologies (HIT) have not yet moved the needle on important outcomes such as productivity, quality of care, and patient safety.

Menon co-authored the paper with Costello colleagues Amitava Dutta and Sidhartha Das.

Based on comprehensive survey data from approximately 6,000 U.S. hospitals, the research team looked into whether those that adopted Clinical Decision Support Systems (CDSS) saw lower mortality rates for cardiac patients.

“CDSS is not only for cardiologists,” Menon explains. “It is hospital-based—a system that helps with clinical decision-making. But we know that many cardiac patients may not necessarily have cardiac as their only problem. There are probably decisions being made about them using all kinds of ailments and medications, and so on.”

The basic idea behind CDSS is to use technology to mine actionable insights from a wealth of patient data, giving clinicians key tools to make informed decisions at the point of care. Theoretically, a hospital with CDSS solutions should be much better equipped to handle complex cases—such as a heart-attack sufferer with diabetes or another comorbidity—in real time than one without.

However, Menon and his co-authors discovered that when it came to preventing deaths from cardiac emergencies, the impact of CDSS was context-specific. Their paper finds a number of complementary effects suggesting that health care technologies need help from their environment in order to be most effective. For example, the presence of cardiac medical services (CMS), e.g. diagnostic catheterization and electrophysiology, was unsurprisingly associated with lower mortality rates—but CMS combined with CDSS was more impactful than either on its own.

“The labor force—by which I mean the physician and the entire team of nurses and technicians—should be trained to use this technology appropriately,” Menon summarizes. “You also need real-time integration between CDSS and other IT systems, because if it’s not well-integrated, the provider will not have all the data at their fingertips. If you don’t provide the right inputs into a CDSS, it’s not going to give you the right outputs.”

Menon points out that the “HIT paradox” isn’t limited to CDSS or any single technology. President Obama’s 2009 economic stimulus package, after all, included tens of billions in financial incentives for health care providers to digitize their patient records. By 2017, 95 percent of U.S. hospitals had adopted electronic patient records. Yet, as Menon tells it, “hospitals are just chugging along. The quality remains the same and the costs are just increasing. Or you might see improvements in one small department. So we are trying to find the variables that create complementarities within large samples.”

Menon knows, however, that the applications of health care tech can be closely targeted to relatively tiny patient populations, too. Another recent paper of his, published in JMIR Medical Informatics, uses causal survival forests, a machine-learning algorithmic technique, to determine which of two chemotherapy drugs promoted the most longevity for terminal prostate cancer patients. Taking into account age, race and comorbidity symptoms, their analysis produced an easy-to-use prescription policy tree that, by itself, could extend patients’ lives by almost two months—if the test sample, comprised of 2,886 veterans treated at VA health centers, was representative of the wider patient population.

“If you go down every branch of the policy tree, the numbers become very small,” Menon says. “It almost becomes like personalized medicine, because you can factor in age, race, gender—although gender didn’t matter in our study—PSA numbers, bilirubin numbers, etc.”

Menon has ongoing research projects aimed at improving health care through technology, at both the patient level (a la the prostate cancer study) and the ecosystem level (a la the CDSS study). One paper in progress focuses on Covid-19 and how the data-sets research scientists selected for their studies influenced their findings. Another looks at telemedicine’s effects on quality of care.

“My foray into health care began with my PhD dissertation, which was on IT in hospitals,” Menon says. “At that time, I was working primarily from a hospital administration point of view. As a business school researcher, it seemed logical to stay there. But as you come across more problems, and you read more, you realize that the patient is the center of everything, not the hospital.”

Topics

Costello Research Health & Well-being at Work

Costello Research Data Analytics

Would you rather buy from a cuddly chatbot, or the “Lipstick King”?

Jennifer Anzaldi — Tue, 04 Mar 2025 18:03:48 +0000

Would you rather buy from a cuddly chatbot, or the “Lipstick King”? Jennifer Anzaldi Tue, 03/04/2025 - 13:03

In This Story

Si Xie

Historically, entertainment and advertising have worked as a tag team, taking turns soliciting attention from audiences. But our social-media age is blending the two into new, hybrid forms.

Witness livestream shopping, a seamless amalgam of e-commerce and entertainment. In place of one-way messaging delivered by polished pitchpeople, this model employs relatable influencers presenting products for online sale—and chatting with consumers—in real-time sessions that often last several hours.

Famously popular in China, livestream shopping is picking up steam in the United States. In June 2024, as an example, U.S. TikTok netted its first million-dollar livestream, courtesy of Texas-based brand Canvas Beauty. By 2026, live shopping may be responsible for as much as five percent of all e-commerce sales in the U.S., according to industry projections.

For global brands, this means a possible revenue explosion. But for information-systems scholars like Si Xie, assistant professor at Costello College of Business, the global rise of livestream shopping represents an unprecedented research opportunity.

Si Xie

“One of the most important elements of livestream shopping is the interaction,” Xie says. “Livestreams bring all potential buyers into the same virtual room, together with the influencer. People can see which products have been put in the online shopping cart, and which have been purchased.”

Her recently published paper in Production & Operations Management finds that the longer an individual product is showcased in a livestream featuring several different brands, the more revenue it will generate. Yet as product showcase duration goes up, overall revenue from the livestream goes down.

To reach their conclusions, the research team—including co-authors Siddhartha Sharma of Indiana University and Amit Mehra of University of Texas at Dallas—analyzed data from nearly 75,000 livestreams conducted in China during 2021.

For Xie, the findings point to a fundamental conflict between the incentives of livestreamers and the brands they promote. It is in the best interest of third-party influencers to move fairly rapidly between different types of products, but brands will want more airtime devoted to each one.

“People like variety,” Xie explains. “If I watch a livestream and all I see are shirts in different fabrics, I might feel there are not too many choices I can make. However, if you show me a shirt and then a pair of pants, I can make an outfit. There’s a higher probability of my making more purchases, and that’s in line with the third-party livestreamers’ incentives.”

One way to correct these misaligned incentives would be for brands to use the power of the purse to influence the influencers. In China, even the suggestion of such corrupting relationships has caused public scandal. In 2023, for example, top livestreamer Li Jiaqi (nicknamed “The Lipstick King” for his ability to sell beauty products) lost one million followers on social media after lashing out at an online commenter who complained about the high price of an eyebrow pencil made by Chinese cosmetics company Florasis. Li, Florasis’s most prominent brand ambassador, was excoriated for ostensibly putting his relationship with the brand above empathy for financially struggling consumers.

“People were saying, ‘you are trying to be defensive of the product because you get so much interest from selling that pencil’”, Xie says. “Therefore, Li’s credibility was really impaired.”

If Xie’s paper describes how human imperfections can jeopardize livestream shopping, could AI be the answer? Indeed, AI-powered animated chatbots — both paired with human influencers, and serving customers solo during off-peak sales hours — have become commonplace on China’s livestreams. For her PhD dissertation, Xie probed data from more than 70,000 livestreams in China and found that introducing an AI assistant boosted livestream sales by about 18%. But the effect steadily declined over time — and not because the novelty wore off. The rapidly improving algorithmic responses had the unintended consequence of shorter watch durations, which may have reduced impulse buying. Xie’s suggested remedy? “The owner of the gen-AI tools could modify the interaction between the virtual livestreamer and the audience to encourage more engagement, perhaps by adjusting the learning speed to ensure that the audience remains engaged for a longer period."

Xie also suggests that brands and channels replace humanoid avatars with cute, cuddly “mascots” that users just can’t bring themselves to click away from.

Xie says she’s working on future papers that tease insights out of livestream data. “One good thing about this new technology is that it promotes the user to buy using methods we can observe. Livestreamers sell general items like grocery items and clothing, as well as expensive stuff like cars and houses, and you can really see how people behave.”

Topics

Costello Research Innovation Strategy

Costello Research Brand Management

Costello Research Retail

George �鶹��Ƶ professor furthers impact of telemedicine in Ukraine

Jennifer Anzaldi — Tue, 14 Jan 2025 22:39:16 +0000

George �鶹��Ƶ professor furthers impact of telemedicine in Ukraine Jennifer Anzaldi Tue, 01/14/2025 - 17:39

Ukraine’s health care system has been hit hard amid the ongoing war. Power outages, staffing shortages, and the destruction of hospitals have added up to a drastic reduction in available care for the already-vulnerable population. In a desperate attempt to bridge the gap, Ukraine’s Ministry of Health opened the country to telehealth solutions from overseas. But will these prove to be a successful substitute for at least some necessary services, or turn out to be no better than a tech Band-Aid?

Answering that question is where Mariia Petryk, assistant professor of information systems and operations management at the Costello College of Business at �鶹��Ƶ, comes in. In her spare time, she works as volunteer director of analytics for TeleHelp Ukraine (THU).

Mariia Petryk

Founded by a cross-disciplinary group of Stanford students shortly after the war’s inception, THU was designed to succeed where other telemedicine initiatives in crisis-affected areas have failed. The founders worked tirelessly to assemble an international volunteer network comprising medical professionals, translators, interpreters and administrative “health navigators.” Aware that medical consultations were only part of the patient journey, THU’s founders sought to address the entire continuum of care.

Petryk stresses that while the project originated at Stanford, the technical team included “people from Chicago, Boston, other California schools…some very active volunteers were in Australia, South Korea, Canada and other countries.”

Petryk, herself of Ukrainian descent, was honored to lend her data science expertise to this worthy project. As analytics director, she manages a dozen or so number-crunching volunteers who measured and documented THU’s impact upon Ukraine’s displaced population during the initiative’s first full year.

As Petryk explains, “The Russian invasion created a humanitarian crisis where a lot of people were internally displaced. And when people relocate to a new place, they don’t know where to go for health care. They also are at higher risk for many issues, including mental health problems. And they don’t know where to turn to treat chronic diseases they may have.”

THU’s primary focus during its first year was delivering much-needed services to this population of war-ravaged internal exiles.

Petryk’s analytical work gave rise to a recent case study of THU published in Journal of Global Health. The paper’s other lead author was Aditya Narayan, a Stanford medical student and THU’s director of implementation and evaluation.

Their findings describe some impressive early successes. THU facilitated more than 1,200 virtual patient appointments from May 2022 to May 2023 alone. Despite often-chaotic conditions, patient attendance rates were above 70 percent for nine of the 13 months studied. As the first year wore on, the THU team found ways to prevent no-shows—for example, employing the popular texting platform Viber to communicate with patients and assigning an individual health navigator to each patient.

Even more impressively, 96 percent of patients reported that their health complaints were at least partially resolved during their visit.

The paper argues that aspects of THU’s model could be adapted for use in other humanitarian contexts. In its initial growth phase, THU had access to advanced technological infrastructure and a wide network of medical providers, by dint of its academic origins. This implies that partnerships with academia could be critical to replicating THU’s success outside Ukraine.

Petryk remains proud of THU’s impact and her role in helping define it. “Based on actual appointments and how much that amount of care would cost at a hospital, THU delivered an estimated $1 million worth of services in its first 13 months,” she says.

Looking ahead to THU’s future, she says, “I can only wish to see this ‘start-up,’ as it were, go for the IPO.”

For more information and to explore volunteering opportunities, visit THU’s website.

In This Story

Mariia Petryk

Connect with the Costello College of Business

Topics

Costello Research Health & Well-being at Work

Costello Research Data Analytics

Faculty and Staff News

Off the Clock

STEM outreach

Are U.S. ‘news deserts’ hothouses of corruption?

Jennifer Anzaldi — Tue, 19 Nov 2024 16:35:27 +0000

Are U.S. ‘news deserts’ hothouses of corruption? Jennifer Anzaldi Tue, 11/19/2024 - 11:35

The March 24, 2021 edition of neighborhood newspaper Northeast News, out of Kansas City, Missouri, contained a surprise for its 9,000 subscribers. Where the front-page news should have been, there was a big, blank white space. This was no printer’s error, but a last-ditch cry for help. After 89 years in operation, Northeast News had found itself on the brink of insolvency due to the loss of key advertisers amid the COVID pandemic. The empty front page was designed to remind the community of what it would lose if its only local paper went under.

The gambit went viral, prompting a flood of online donations that is keeping the paper afloat, for now. Ironically, Northeast News owes its existence to the very force that has fueled the more general decline of local journalism in America—the internet.

Brad Greenwood

As advertiser dollars migrated to Facebook and Google, the business model that supported local newspapers for generations came to the edge of collapse. Since 2004, more than 2,500 American newspapers have ceased publication—around one-quarter of the total. Overall newspaper circulation has declined by more than half since 1990.

To be sure, digital alternatives have rushed in to fill the gap, such as citizen-journalist websites, nonprofit news organs, partisan blogs, etc. So, the question represented by the blank front page of Northeast News resonates: What do communities lose when newspapers fold that online journalism startups haven’t (so far, at least) been able to replace?

In the past, industry observers and researchers have linked community newspaper closure to diminished civic trust and political participation, among other negative effects. New research from Brad Greenwood, the Maximus Corporate Partner Professor of Business at the Costello College of Business at �鶹��Ƶ, builds on this discourse, finding evidence that when local papers topple, political corruption springs up in their wake.

Greenwood’s paper, coauthored by Ted Matherly of Tulane University, was published in MIS Quarterly.

The researchers focused on U.S. federal districts that lost a major daily newspaper during the years 1996 to 2019. They compared the number of corruption charges (bribery, embezzlement, fraud, etc.), defendants, and cases filed in district court before and after the newspaper closure. The results were striking: Overall, the disappearance of a newspaper delivered a 6.9% increase in charges, a 6.8% increase in the number of indicted defendants and a 7.4% increase in cases filed.

“We looked at federal charges for three reasons. First, the overwhelming amount of statutory enforcement occurs federally. Second, it gives us a uniform definition of what constitutes corruption across every domestic jurisdiction. Finally, and most importantly, federal conviction rates are over 90%,” Greenwood says. “They don’t charge people unless they have a good-faith belief they will prevail at trial.”

Moreover, post-newspaper corruption cases were more likely to go to trial as opposed to resolving in a plea deal, thus incurring greater public costs.

“In an age of misinformation, the solution is not rejecting the professional press, it is embracing it, and ensuring that well-trained and hard-working men and women have both the ability and venue to hold those in power to account."

Greenwood and Matherly also examined whether digital-era upstarts were adequate substitutes for newspapers, in terms of curtailing corruption. They tracked 352 such websites, and found they had no impact on the number of charges, defendants or cases in the districts concerned.

“While it’s hard to say precisely why we don’t see an effect from online news, there are several candidate explanations. Not only do citizen journalists lack the standing and training to tackle questions of public corruption and elevate discourse in the public square, but many of these sites aren’t even legitimate news vendors,” says Greenwood, referencing what are commonly referred to as “pink slime websites.”

Greenwood goes on to suggest that the corruption-preventing power of the defunct papers came not necessarily from journalistic acumen, but rather from the ability to elevate the actions bad actors had taken in public discourse, a process journalism researchers refer to as agenda setting.

Whatever the cause, the ramifications for society are very real. In the Northern District of Illinois alone, corruption-related cases involving more than 1,700 officials cost taxpayers a staggering $550 million per year from 1976 to 2012. The coffers of communities that lose newspapers may suffer more than most, since these cases tend to end up in expensive courtroom proceedings rather than plea deals.

Further, the study only looks at corrupt officials who got caught. Presumably, there are many more whose corruption went unpunished.

All told, these findings suggest that community newspapers should not be regarded as just another business model ill-adapted to digital disruption that should be allowed to fail. Their demise comes at significant public cost, financial and otherwise. “In an age of misinformation, the solution is not rejecting the professional press, it is embracing it, and ensuring that well-trained and hard-working men and women have both the ability and venue to hold those in power to account,” Greenwood says.

In This Story

Brad Greenwood

Topics

Costello Research Business Model Innovation

GenAI brings us closer to automating investment expertise

Jennifer Anzaldi — Thu, 22 Aug 2024 18:39:34 +0000

GenAI brings us closer to automating investment expertise Jennifer Anzaldi Thu, 08/22/2024 - 14:39

In This Story

Yi Cao

Long Chen

Large language models (LLMs) such as ChatGPT and Google Gemini excel at being trained on large data-sets to generate informative responses to prompts. Yi Cao, an assistant professor of accounting at the Donald G. Costello College of Business at �鶹��Ƶ, and Long Chen, associate professor and area chair of accounting at Costello, are actively exploring how individual investors can use LLMs to glean market insights from the dizzying array of available data about companies.

Long Chen and Yi Cao

Their new working paper, co-authored with Jennifer Wu Tucker of the University of Florida and Chi Wan of University of Massachusetts Boston, examines AI’s ability to identify “peer firms,” or product market competitors in an industry.

Cao explains the significance of selecting peers by relating this process to the real-estate market. “The capital market is similar to the real-estate market in that a firm’s value is partially determined by the value of its peers. In the real-estate market, we price a home based on the value of comparable properties in the neighborhood, or the so-called 'comps.' In our paper, we aim to leverage the power of LLMs to identify comps for evaluating firm value.”

This task is at least as difficult as it is essential. It takes much time, skill and effort to gather, aggregate and manage data to select peers. However, the researchers reasoned that LLMs could do a lot of the heavy lifting of data aggregation and analysis for the individual investors, and produce a list of peers comparable in validity to that identified by human experts.

“The advantage is in the capability to utilize all the information potentially out there so that it is at least performing as well as other traditional methods that can help us investors and researchers,” says Cao.

For the study, Chen and Cao employed Bard from Google, now known as “Gemini,” as their LLM of choice because “Bard has a greater ability to utilize its pre-training data, which is arguably larger than ChatGPT’s and with more parameters,” says Cao.

After defining “product market competition” and forming a prompt for Bard, the researchers instructed Bard to limit its knowledge pool to a specific year within the period 1981-2023, in order to avoid “look-ahead bias,” i.e., future information scrambling the results.

“We need to understand that LLMs are actually a very powerful, new tool, unmatched in their efficiency, ability to process vast amounts of information at a low cost, and accessibility to the general public.”

They limited focal firms to large, publicly listed companies as there is less data out there for smaller or private firms. In all, the data-set comprised more than 300,000 focal firm-years.

On average, the LLM could generate about seven peer firms for a focal firm, a number that is similar to the SEC recommendations on how firms should disclose their segments.

The researchers then compared the LLM’s performance to the lists generated by three human experts for a set of 40 leading computer software companies. The average overlap was a little over 40 percent, greater than expected.

They also compared the AI-identified peer lists to two alternative systems for identifying peers: the federal government’s Standard Industrial Classification (SIC) codes and Text-based Network Industry Classification (TNIC), which compares firms based on linguistic similarities in their 10-K filings. The LLM’s output overlapped significantly with TNIC’s. Plus, the peers identified by the LLM were generally a better fit than those from SIC and TNIC, as their monthly stock returns hewed closer to the focal firm.

But TNIC outperformed the LLM in identifying peers for mid-sized firms within the sample, indicating that it is not a clear-cut case of universal LLM superiority.

“It’s especially beneficial for individual investors—as all the cost concerns that we’re talking about are especially relevant for them,” Chen adds.

Regarding the future of LLM, Chen states, “There are always costs and benefits associated with using generative AI. It is uncertain whether current systems will soon be obsolete.” When asked about the SEC adopting an AI tool for investors, Chen emphasizes that users need to understand the pros and cons of using AI to make their informed judgments “because AI cannot be held responsible for the information it provides or for how it is utilized.”

Chen concludes, “We need to embrace this new technology, but we must recognize that it is not yet in a perfect state. Competition to improve the technology is fierce. Our findings might just represent the lower bound of the effectiveness of the technology.”

Topics

Accounting - Costello

Costello Research Innovation Strategy

Costello Research SEC/PCAOB

Costello Research Private Funds

Costello Research Market Efficiency

Accounting Faculty Research

Artificial Intelligence

The NYPD gave officers iPhones. Here’s what we learned about race and policing

Jennifer Anzaldi — Tue, 04 Jun 2024 16:50:43 +0000

The NYPD gave officers iPhones. Here’s what we learned about race and policing Jennifer Anzaldi Tue, 06/04/2024 - 12:50

In This Story

Brad Greenwood

The controversy about biased policing seems to draw endless fuel from race-based differences in public perception. Simply put, the vast majority of White citizens in the United States believe the police are doing a good job, including on issues of racial equality, while a similar percentage of Black citizens hold the opposite opinion. And while a growing number of studies have indicated persistent patterns of racial discrimination in policing, an emergent concern among scholars is that the data these papers rely on are also subject to baked-in biases, since they often derive from officers’ self-reports of their own behavior.

Brad Greenwood

Enter Brad Greenwood, professor of information systems and operations management at the Donald G. Costello College of Business at �鶹��Ƶ. One of his research interests lies in how digital technologies are bringing unprecedented transparency to police practices. For example, Greenwood’s 2022 paper documented how the introduction of body-worn cameras for the New York Police Department (NYPD) resulted in a significant reduction in abuse-of-authority complaints.

His latest work on policing is forthcoming in Proceedings of the National Academy of Sciences. Along with Gordon Burtch from Boston University and Jeremy Watson from the University of Minnesota, Greenwood examined the recent rollout of iPhones across the NYPD, which included a series of digital tools designed to replace the handwritten memo books officers previously relied on. Instead of scribbling in the physical books, which NYPD officers were required to hang onto even into retirement, officers could log their activities directly into a centralized database maintained by the NYPD. These detailed digital records shed fresh light on how cops spend their time—and attention—on the beat.

The researchers tracked data on NYPD stops and complaints in 2017 and 2018, the period when iPhones were being rolled out across precincts in New York City. A curious pattern emerged. There was an 18% increase in reported stops after a precinct received iPhones, which would be consistent with the digital tools making it easier for officers to report a citizen interaction. Further, the researchers discovered that this increase resulted in neither more arrests nor more complaints from the public. It wasn’t, therefore, that the phones were somehow causing the police to stop people more often, but rather that so-called “unproductive stops”—those leading to no further action—were being reported more often.

However, when breaking the results down across White and non-White citizens, the researchers found that unproductive stops involving non-White citizens were entirely responsible for the increase. In other words, the observed changes were based on police encounters with non-White members of the public, that would likely have gone unreported in the days of pen and paper. More specifically, after switching to the smartphone system, officers logged 22% more stops involving non-White citizens, while the number of reported stops of White citizens remained unchanged. These are statistical averages—the pattern was more marked in high-crime neighborhoods and those with a greater proportion of non-White residents.

Greenwood offered an interpretation of the finding: “The concern here is that we have an underreporting, which is concentrated in certain groups and means that we need to be cautious when interpreting prior work. On the one hand, it opens the door to bias in police interactions with civilians being worse than initially anticipated, at least based on the frequency of stops. On the other hand, it could mean that older data doesn’t accurately reflect the likelihood of an arrest once a stop occurs. And we need to be doubly cautious, because we don’t know if officers are reporting stops more frequently just because it is easier, or for some other reason.”

Greenwood cautions against making sweeping conclusions based on the study. “The only thing we know for sure is that more and deeper work is needed by scholars and policy makers to ensure transparency between law enforcement and the people they are charged to protect,” he said.

On the whole, however, the study raises the possibility that race-based disparities in policing are not only very real, but may have been underestimated thus far because of reporting gaps.

As police officers are not obligated to document all civilian interactions, their decisions regarding what—and what not—to report can be biased. The introduction of new technology, as in the case of the NYPD, can help counter such biases, but is not the only avenue worth pursuing. The researchers recommend that police departments “investigate the appropriate organizational complements (i.e., policies and procedures) necessary to uncover and eliminate such biases.”

Topics

Costello Research Cybersecurity

Costello Research Data Analytics

impact fall 2024

George �鶹��Ƶ faculty are tackling cybersecurity’s talent pipeline problem

Jennifer Anzaldi — Fri, 10 May 2024 17:01:06 +0000

George �鶹��Ƶ faculty are tackling cybersecurity’s talent pipeline problem Jennifer Anzaldi Fri, 05/10/2024 - 13:01

If you’re a cybercriminal, the latest news on cybersecurity talent shortfalls should put a smile on your face. For example, the majority of cybersecurity leaders report that their teams are understaffed, and they have problems retaining qualified professionals.

But for Nirup Menon, a �鶹��Ƶ professor of information systems and operations management (ISOM), and Brian Ngac, an instructor in the ISOM area, this workforce challenge is a golden career opportunity for the young people of Northern Virginia and the Washington, D.C., area.

Nirup Menon and Brian Ngac

The pair recently won a two-year award from the National Institute of Standards and Technology (NIST), an agency within the U.S. Department of Commerce, to create unique experiential learning opportunities and workshops designed to enhance cybersecurity education and workforce development.

Working closely with industry partners Mobius Consulting and Institute for Defense Analyses (IDA), Menon and Ngac will recruit and help select students to work on actual cybersecurity projects. “They need to have taken some fundamental cyber class ahead of time,” Menon clarifies. “We want students with a commitment to the field. It allows you to get experience but it’s also competitive.”

Throughout the 12-week projects, students will receive mentoring both from the industry participant and from business faculty. “We run it in an agile scrum-like manner,” Ngac says. “Every week, we ask ‘What did you do?’ ‘What are you going to do?’ ‘What are the challenges that are impacting your work?’” If students run into trouble, faculty mentors can work with industry managers to help them get back on track.

“We’re trying to build not just the cyber workforce but the skills as well,” Ngac says.

Menon and Ngac have developed a specialty in this type of hands-on learning, which they have dubbed the Professional Readiness Experiential Program (PREP). More than 100 Virginia-based undergraduates and 20 industry participants have participated in PREP, which includes projects funded by two Commonwealth Cybersecurity Initiative Experiential Learning grants in collaboration with Mobius and IDA.

“PREP not only focuses on cybersecurity projects, but also works on many business process improvement projects,” says Ngac. "Honors and high-performing ISOM students work on real-world projects with industry participants on identifying technical solutions to business challenges through rigorous research, modelling, analysis, quantification, risk management, implementation planning, and, at times, execution.”

The NIST award also incorporates workshops for students who are new to cybersecurity but interested in exploring it as a career option. Workshops will be launched in collaboration with Trinity Washington University (TWU), a PBI (predominantly black institution) and HSI (Hispanic-serving institution) whose College of Arts and Sciences is women-only. For a field such as cybersecurity, which continues to face diversity challenges, the participation of organizations such as TWU is essential.

“We want to bring in students who have not thought of cybersecurity as a field, because they think it’s all engineering, hacking and coding,” Menon says. The workshops will emphasize the variety of functions that are integral to the space, such as management and auditing, in addition to engineering.

Students and industry participants in the current CCI Experiential Learning Projects

“It’s not just tech, there may be creativity involved in anticipating scams and threats,” Ngac explains. “These are different things we’ll be bringing up in the workshop in terms of roleplaying what cybercriminals might do, or how someone might try to socially engineer an attack.”

Unlike a standard grant, the NIST award is structured as a cooperative agreement in which the funding agency will collaborate in shaping and delivering programs as they evolve.

“The advantage of working with NIST is that top people work there. They are the standards body, so they have seen and surveyed a lot of industry,” Menon says. He also lauds NIST’s high-level view of cybersecurity and its implications. “They’re not just looking at technology but also public policy, human factors, etc. It’s a holistic approach.”

Organizations interested in being an industry participant (whether they have cybersecurity-focused or business process improvement-focused projects) with PREP are encouraged to contact Brian Ngac.

Join the �鶹��Ƶ Nation

Topics

Costello Research Cybersecurity