Identity Resolution Daily

By Robert Barker, Infoglide Senior VP & Chief Marketing Officer

In a recent post, Jonathan McDonald quotes one definition of entity resolution:

According to Gartner, entity resolution is “the capability to resolve multiple labels for individuals, products or other noun classes of data into a single resolved entity when pseudonyms, alias names or other synonym-style constructs exist. This is especially true in cases wherein there exists intentional falsification of information or the creation of false identities. While most prevalent in detecting perpetrators of criminal or illegal activity, more-commercial applications exist as well.

While the definition nicely captures the value of “first degree” entity resolution, it falls short by omitting non-obvious relationship detection.

Basic entity resolution determines “who’s who” by sifting through massive amounts of noun/attribute data in multiple disparate data sources. Cutting through ambiguity caused by missing attributes, pseudonyms, aliases, and obvious efforts to deceive, it mines and resolves the essential elements of identity to form an unambiguous picture that greatly enhances business decisions and reduces risk.

However, in many application domains, pinpointing “who knows whom” is equally valuable. In detecting insider trading, for example, it’s important to resolve identity information to achieve an unambiguous picture of a person of interest, but to expose fraudulent activity, it’s critical to identify second and third degree linkages between suspects and their friends, relatives, and business associates.

More examples abound. In insurance, fraudsters change roles each time they stage a car accident and also intentionally modify their identities in accident reports. Fraudulent employers who want to reduce their workers’ compensation premiums will close their company and start a new one with modified identities of corporate officers. In retail, non-receipted returns of merchandise are often linked to store employees and the customers they enlist to act as their confederates. The list goes on and on.

In each case, entity resolution finds hidden connections by evaluating multiple ambiguous attributes with the same algorithms used to resolve identities. A retail employee who takes a customer’s winning lottery ticket (while telling the customer he didn’t win!) can be traced through address and phone information to other suspiciously connected people, e.g. frequent lottery winners and lottery commission employees.

With apologies to the experts at Gartner, here’s a suggested addition to the definition that acknowledges the other half of entity resolution:

The capability to (a) resolve multiple labels for individuals, products or other noun classes of data into a single resolved entity when ambiguity from pseudonyms, alias names or other synonym-style constructs exists, and (b) to expose hidden connections between entities that are two or more degrees of separation apart. This is especially true in cases where there exists intentional falsification of information or the creation of false identities. While most prevalent in detecting perpetrators of criminal or illegal activity, more-commercial applications exist as well.

Share This

By the Infoglide Team

New York Times: Name Not on Our List? Change It, China Says

“By some estimates, 100 surnames cover 85 percent of China’s citizens. Laobaixing, or “old hundred names,” is a colloquial term for the masses. By contrast, 70,000 surnames cover 90 percent of Americans. The number of Chinese family names in use has tended to shrink as China’s population has grown, a winnowing of surnames that has occurred in many cultures over time.”

OCDQ Blog: All I Really Need To Know About Data Quality I Learned In Kindergarten

“When you present the business case for your data quality initiative to executive management and other corporate stakeholders, remember the lessons of show and tell.  Poor data quality is not a theoretical problem - it is a real business problem that negatively impacts the quality of decision critical enterprise information.”

BTNonline: Secure Flight Roils Booking Tech

“To facilitate the implementation of Secure Flight’s new data requirements for the travel industry, officials from the International Air Transport Association and Department of Homeland Security this year decided to use passenger data fields already used to transmit visa and passport information. TSA noted those IATA standards go into effect May 1.”

Security Systems News: Retail industry to ’speak with a single voice’

“There will now be a single entity both helping to establish best practices for loss prevention and lobbying state and federal government in regard to major security issues like organized retail crime.”

Share This

This post is based on a March 31 interview with Infoglide Senior Vice President Douglas Wood by Linda L. Briggs for TDWI (The Data Warehousing Institute), March 31, 2009. Click here to read the entire interview.

In a comprehensive discussion, Doug Wood of Infoglide Software spoke about an area of confusion that exists when people discuss identity resolution. He pointed out that the term is sometimes misapplied to describe software that performs data matching alone.

[An identity resolution engine is] software that allows organizations to connect disparate data sources in order to understand possible entity matches and non-obvious relationships. It boils down to this: Providing capabilities for organizations to understand “who’s who” and “who knows whom” across multiple data silos. Occasionally, when we introduce the concept of identity resolution technology to a new customer, their immediate response is “I see, but we already have a data matching engine.” The truth is, identity resolution engines have data matching at the core, but [they] provide much more functionality and flexibility than that.

So if identity resolution incorporates data matching, what really differentiates it from data matching products?

Perhaps the key element of an identity resolution engine is the ability to take the entity match and relationship results, then apply domain-specific rules to them. How does the enterprise treat Customer A by virtue of the fact that he or she has some non-obvious relationship with Customer B? The answer to that question is specific to the domain.

Most of us are familiar with the use of data matching for removing duplicates from databases and in cleansing input for data warehouses and master data management, but identity resolution is used in unique ways.

With identity resolution technology, data isn’t subjected to deterioration processes such as cleansing or record merging. Rather, the data can remain in its original state and in its original location.

What this means is that identity resolution is especially adept at uncovering risk, fraud, and conflicts of interest since the “forensic value of individual records is preserved for ongoing analysis.” While government is a key market for identity resolution engines, a growing number of commercial applications are emerging in financial services (e.g., PATRIOT Act compliance, detection of loan fraud and credit card fraud), retail (e.g., uncovering organized retail crime activities by comparing shoplifters with employees or frequent merchandise returners), workers compensation (e.g., finding employers that change attributes to avoid paying premiums), lottery corporations (e.g., compare winning ticket holders against lottery retail employees to discover potential fraud), and customer relationship management (e.g., keeping two similar records unmerged until birth date attribute uncovers a father/son relationship).

What prevents traditional data matching products from addressing these problems?

There are no problems with matching engines per se. They just aren’t identity resolution engines. Matching engines typically use one or two algorithms, perhaps mathematical in nature, that examine structured data looking for name matches. They provide an improvement over Soundex, but little more. What they do is say “Yes, this is a match” or “No, this is not a match.”

Common requirements for solving identity resolution problems include connecting to more diverse data types and formats, handling higher volumes, and delivering deeper insight into non-obvious relationships from existing uncleansed data sources.

If identity resolution engines have existed for years, what has caused the recent rush to employ them?

As part of the 9/11 Commission recommendations, the Department of Homeland Security began a robust search for identity resolution technology that could keep terrorists off airplanes by comparing passenger attributes against terrorist watch lists, no-fly lists, and other types of threat-related data. Through a few iterations, the selection and implementation process evolved into the Transportation Security Administration’s (TSA) Secure Flight Program, which ultimately thrust identity resolution technology into the limelight. Secure Flight is now widely recognized as the pre-eminent use case for identity resolution technology requirements today, and a number of companies are involved in delivering that solution.

Share This

By the Infoglide Team

Background Now: AG Seeks Injunction Against Contractors Asset Protection Association, Inc. (ConAPA) and Eugene Magre

“‘This company falsely promised its clients that if they gave their employees empty titles and worthless shares of stock they could avoid tens of thousands of dollars in workers compensation premiums,’ Attorney General Brown said. ‘But you can’t simply call a security guard a vice president and avoid complying with the law through a sophisticated and fraudulent scheme.’”

DailyTech: New Bills Target Stolen Merchandise Sold Online

“Under the new legislation, the brick and mortar retailers would score a major coup in that they could order eBay.com, Overstock.com, and Amazon.com to remove numerous goods without any proof.  Under the proposed laws, failure by the online retailers to ‘expeditiously investigate’ and remove the items would result in criminal penalties.”

BeyeNetwork: Business Drivers and Master Data

“Is the actual business need for a single version of the data, or just multiple versions, each of which is of higher quality? Drill down into this a little bit and you may need additional information from your business customers. What constitutes a requirement for master data? A situation in which two business processes need to have a fully shared view of the same representation of a data item?”

Web of Data: Report on Data Discovery by Bloor Research

“…there are now a number of products on the market that can discover data relationships that do not fall within the category of either data profiling or data quality. As a result, it is time to consider the importance of data discovery, and its requirements, as a market in its own right.”

Share This

[Post from Infoglide] The Human Element in Identity Resolution

We’ve written quite a few posts here on the subject of identity resolution’s application to a broad range of problems that include terrorism, insurance fraud, crime, lottery fraud, sexual predators, workers comp employer fraud, and retail returns fraud. What we haven’t discussed very much is the relationship between the technology and the human beings that employ it.

Boston Globe: Woman to be sentenced in asbestos case

“Deleon ‘cheated the system’ in two ways to enrich herself, according to the government’s case. Under her ownership, Environmental Compliance Training issued false asbestos removal training certificates and lied about it to the state. She also evaded payroll taxes and workers’ compensation insurance premiums by paying hundreds of employees of Methuen Abatement Staffing under the table. The company had a gross unreported payroll of $4.6 million from 2002 to 2006, according to a government document introduced at the trial.”

New Mexico Independent: Homeland security ‘fusion centers’ are working, but concerns abound

“The federal assessment of the nation’s fusion centers — which borrows heavily from earlier reports by such internal watchdogs as the Congressional Research Service (CRS) and General Accountability Office (GAO) — lists a few privacy, transparency and oversight concerns about the fusion centers.

Wall Street Journal: Tips for TSA to Make Flying Safer, Easier

“Some experts suggest that the TSA cut back on the air marshal program, which puts law-enforcement agents on some flights, and shift spending to more effective security measures. Experts also want to see major changes in the current Registered Traveler program to further speed up security procedures for frequent travelers and focus resources on travelers who haven’t undergone background checks. They also want to see more variation to today’s predictable screening so bad guys don’t know exactly how to circumvent security.”

Gartner: Can “single view” of master data be achieved without an MDM technology?

[Andrew White] “Certainly users have been trying to achieve ’single view’ for many years, before the phrase master data management was coined.  The problem of trying to maintain a semantically consistent definition of master data across the business has been a long standing desire for most firms.  It is because business (and to a great extend, IT also) has grown to be so complex, that since 2000 many firms have begun to look to specific tools to help.”

WorkersCompensation.com: Chenango Man Charged As Fraud In Fish Story

“Investigators from NYSIF’s Division of Confidential Investigations said Mr. Panus was receiving workers’ compensation payments for a work-related back injury that occurred in 1988. The investigation, conducted in cooperation with the New York State Insurance Department Frauds Bureau and the Office of the Workers’ Compensation Fraud Inspector General, found that Mr. Panus was allegedly self-employed as the owner of Ponderosa Fish Farm while receiving benefits totaling $66,100.”

Share This

By Robert Barker, Infoglide Senior VP and Chief Marketing Officer

We’ve written quite a few posts here on the subject of identity resolution’s application to a broad range of problems that include terrorism, insurance fraud, crime, lottery fraud, sexual predators, workers comp employer fraud, and retail returns fraud. What we haven’t discussed very much is the relationship between the technology and the human beings that employ it.

We software marketers are sometimes tempted to make it sound as though our products solve problems automatically. The truth is that identity resolution software performs tasks that humans could do, but it does them at a level of speed and precision that significantly enhances the results accomplished through those tasks. In order for the software to achieve excellent results, however, human judgment is required both in implementing the software and in applying the results.

The specifics of a particular problem differ markedly, and every solution is different. A person of interest in airline passenger screening has very different characteristics from a person of interest in workers compensation fraud, for example. Solutions differ even within a single problem domain, e.g. Nordstrom and Walmart have very different philosophies for merchandise returns.

In simpler data quality applications, default configurations can address many problems, but in identity resolution, a little tuning by experts greatly increases the solution’s value.  A domain expert may not understand the technology, but they understand their problem, industry, application, and company. And because of their depth of understanding of their domain, they can tell great results from good results in a heartbeat.

For maximum benefit, human domain experts work with technology experts to tune the software during implementation to apply similar “judgment” as the experts themselves would use to resolve multiple identities, uncover hidden relationships, and minimize false positives and false negatives. Technology’s critical role is to automate the process of sifting through the data to find likely matches and non-obvious relationships and to prioritize the cases that require human intervention so that finite human resources can focus on the most important things first.

While it’s critical to have software that can produce results right “off the shelf,” it is the domain expertise coupled with the technology expertise that creates a solution that is perfectly matched to the needs of a particular industry, application, and company.

Share This

By the Infoglide Team

Benefit Fraud: Where are the deterrent sentences for benefit fraud?

“A repeat offender pedophile is on incapacity benefit [workers comp]. Why, one wonders. He seems to be well enough to assault 13 year old girls but not well enough to work.”

ebiz: While Business Intelligence Needs to Move from Passive to Active

“So, the difference is that you’re looking at information that tells you where you made mistakes, and perhaps how to avoid them in the future. Or, that you’re looking at information that tells you you’re about to make a mistake, perhaps in the context of historical information, and takes corrective action immediately without human intervention. Which seems more productive to you?”

Portland Press Herald: Hit-and-run thieves strike Maine stores

“Loss-prevention specialists say eBay, Craig’s List and other online auction and free advertising sites have fueled the increase in retail crime because they provide a new and anonymous way for shoplifters to resell stolen goods. ‘The best thing to happen to shoplifting is the Internet,’ said Strong.”

North Country Gazette: Self-Employed Plumber Nabbed For Scam

“While receiving benefits, Hogdin attested in signed statements that he had not returned to any form of work.  An investigation carried out by the New York State Insurance Fund’s Division of Confidential Investigations revealed that Hogdin, in fact, was self-employed repairing small engine machinery.”

Share This

[Post from Infoglide] Does Data Matching Qualify as Identity Resolution?

“Any true identity resolution engine must not consist simply of a mathematical matching equation, nor must it rely upon data-deterioration processes such as ETL and data warehousing. Math cannot tell a user that Ian is an acceptable nickname for John, nor can simple mathematical equations point to similarities between the colors grey and charcoal.”

Fiscal Policy Institute: Building Up New York, Tearing Down Job Quality

“As buildings go up in New York City, more and more construction work has gone underground, signifying violation of several employment and tax laws. An estimated 50,000 New York City construction workers—nearly one in four—are either misclassified as independent contractors or employed by construction contractors completely off the books.”

SearchDataManagement: Enterprise-wide customer data quality still elusive at most organizations

“So why do so few organizations use data quality tools for customer data enterprise-wide? The reason, according to some, is that most companies collect and store customer data in numerous data sources spread throughout the organization with no way to connect them. Put another way, lacking a single view of the customer through a master data management (MDM) system or customer data integration (CDI) initiative, organizations lack any realistic way of applying data quality tools enterprise-wide.”

WorkersCompensation.com: Rome Man Accused Of Double Dipping

“A 58-year-old Rome man discovered working after he claimed a job-related injury prevented him from doing so was arrested Thursday on charges that he fraudulently collected $17,940 in workers’ compensation benefits.”

Multichannel Merchant: Retail Crime Up Thanks to Down Economy

“According to the National Retail Federation’s 2008 Returns Fraud Survey, released in November, retailers will see a total of about $219 billion in returns from sales made in 2008 – a 19% increase over the $178 billion in returns recorded in 2007. Of those returns, about $11.8 billion will be fraudulent – an increase of about 8% over last year’s figure of $10.9 billion.”

Share This

By the Infoglide Team

Illinois Business Journal: Closing fraud loopholes would decrease Illinois’ workers’ comp costs

“Workers’ compensation costs for Illinois employers are higher than any of its bordering states, according to Jay Shattuck, executive director of the Illinois Chamber Employment Law Council. Illinois’ average total cost per claim, he says, is $21,335 - compared to Indiana’s $10,517, Wisconsin’s $11,342, Iowa’s $14,292 and Missouri’s $17,309.”

Hub Solution Designs: MDM: Buzz-Worthy But Not A Back-Breaker

“The software vendors who’ve flocked to MDM and put the MDM label on everything under the sun have certainly confused the market. Even so, the MDM software market grew 24% from 2007 to 2008.  In spite of the tough economic times we’re currently in, that rapid growth rate should continue for the next several years.”

Hi-Tech-Blog: Economy down = Employee theft up

“Brian J. Mich, head of anticorruption compliance and investigations at BDO Consulting, says during tough financial times, ‘people have a tendency to give in to temptation to commit criminal behavior,’ and that employers tend to become more vigilant. Mich also observes that people viewed as the most trustworthy–those who have ‘access to systems and information’–often commit the biggest thefts.”

Crain’s New York Business: Shoplifting increases at retail stores

“According to the nationwide study, 84% of retailers, including department stores, specialty apparel companies, electronic stores and drugstores, have seen an increase in theft and amateur shoplifting over the last three months. More than 75% of stores report a rise in financial fraud, and 80% cite intensified organized retail crime.”

Share This

By the Infoglide Team

Intelligent Enterprise: Master Data Management Adoption Going Strong

“Business units and IT departments collaborate, cleanse, publish and protect common information assets that are shared across the enterprise. Gartner, however, cautioned that there is no single technology that meets all MDM user requirements, and products vary by technology, industry, data domain and use case, and many span multiple domains.”

Insurance & Financial Advisor: New York man arrested for workers’ compensation fraud

“Queen is accused of accepting $3,000 in workers’ compensation benefits from the New York State Insurance Fund and stating that he was not working as the result of a job-related knee injury. He later collected $7,000 in workers’ compensation benefits from AIG insurance, claiming an injury to the same knee that prevented him from working.”

CIO: The Ugly Truth About “One Version of the Truth”

“‘Many organizations spend months and endure significant costs to obtain the reporting and analysis capabilities that BI promises,’ Hatch writes, ‘only to find that different ‘versions of the truth’ still exist without any definite way of determining which one is real or accurate.’”

Chronicle Herald: Flight rules raise privacy worries

“The name, gender and birth date of Canadians flying from Toronto to destinations such as Cuba, Mexico or even Europe will be transmitted by airlines to the TSA under its Secure Flight program, to take effect next year. The agency will then vet the names against security watch lists aimed at keeping dangerous people on the ground.”

DN/Online: Ask me about my panties

“Retail theft is on the rise and the National Retail Federation said in its 2008 report that 68 percent of retailers have been able to identify or recover stolen merchandise and gift cards on online auction sites, 61 percent more than last year. The report also indicated that 63 percent have seen an increase in e fencing selling stolen items on online auction sites - activity in the last year.”

Seacoastonline.com: Beware organized crime online

“Organized retail crime involves the organized theft of retail merchandise that is resold to consumers through online auction sites and through other outlets, like local flea markets. These organized crime rings target over-the-counter pharmaceuticals, baby formula, tobacco cessation products, pregnancy strips, diabetic test strips, cosmetics and similar types of personal care items.”

bobsguide: Recession gives rise to online fraud fears

“Business Journal said the study by fraud detection specialist 41st Parameter and the Merchant Risk Council found that 84 per cent of respondents are concerned that internet retailers will face a ’slight or substantial’ increase in fraudulent activity.”

Share This