Identity Resolution Daily

By Ram Anantha, Infoglide Director of Product Management

Big Master Data Management (MDM) issues are swirling around these days, not the least of which is the role of identity resolution. We’ve posted multiple times about MDM, customer data integration (CDI), data quality (DQ), and related topics. People sometimes are unsure about the relationship between identity resolution and these areas. Most of the time, they are complementary. Identity resolution can play a critical and unique role in each case.

Given that background, we’re looking forward to attending the MDM Summit Fall 2008 that starts October 19 in the Big Apple and is put together by Aaron Zornes of the MDM Institute. We suggest that you join us in checking out presentations, panels, and demos from forward-thinking companies like DataDelta, DataFlux, and NominoData. Also, look for events involving thought leaders like Aaron, Jill Dyché of Baseline Consulting, David Loshin of Knowledge Integrity, and Dan Power of Hub Solution Designs.

As a reader of this blog, you especially don’t want to miss the expert panel on “Trends in Identity Resolution for MDM” with Ed Allburn of DataDelta and Al Macdonald of NominoData. It’s Tuesday, October 21 at 1:45pm.

Hope to see you there!

Share This

By the Infoglide Team

Lottery Scam: Lottery Scam Watch - Keep Track of Your Tickets

“The ticket was bought in May. When the ticket holder came to the store for verification, the clerk allegedly told him he was mistaken and kept the ticket. A police report contends that Melissa Trahan, 27, sent the winning slip to her mother in Mississippi. That woman, Gwen Landry, drove to the state capital, Baton Rouge, and cashed it in for the $800,000.”

Hub Solution Designs: Customer Data Quality

“Sometimes, attempts are made to programmatically improve data quality within a customer record, but because of tight deadlines, data quality across the file is usually not given serious attention.”

CT.gov: Waterford Town Employee Charged with Workers’ Compensation Fraud

“The warrant alleges that Mr. Hall ‘intentionally misrepresented his claimed injury and intentionally failed to disclose his employment and wage earnings while collecting disability benefits.’”

Homeland Security Watch: Senate Introduces its First DHS Authorization Bill

“The Senate bill elevates the assistant secretary for policy to the position of Under Secretary for Policy, to ensure policy coordination across the Department, it strengthens the authorities of the Office of International Affairs at DHS, and it authorizes the National Cyber Security Center, along with a private sector board to advise the Secretary on cyber security policy.”

Workers Compensation: California Fines Auto Body Shops Without Workers’ Comp Insurance

“Failure to carry workers’ compensation insurance is fraud, plain and simple. This is a form of workers’ compensation fraud – not having the appropriate coverage – is more common than you might think.”

Central Coast News: Santa Cruz police crack large commercial burglary case at Safeway

“Safeway loss prevention officers notified Santa Cruz police on Sept. 9 that the company’s store on Morrissey Boulevard had lost a significant amount of merchandise to theft and store managers suspected that an employee, Emanuel Anthony Ruiz, 30, was stealing merchandise. He allegedly took cosmetics, shoes, clothing and over-the-counter pharmaceutical items, including medications, from the store, police reported. Ruiz, with the help of the three others arrested, was then selling the items online, police said.”

Share This

[Post from Infoglide] California Lottery Fraud

“[N]ow state and provincial authorities are shifting resources to address another rapidly growing problem: lottery fraud committed by retailers. The most highly-publicized case of retailer lottery fraud in recent years occurred in Ontario but cases reported by the California Lottery Commission, perhaps the largest lottery in the U.S., indicate that they have a rapidly growing problem as well.”

Information & Data Quality Conference 2008 Blog: IAIDQ Announces Plans for Certified Information Quality Professional certification

“The IDQ 2008 conference is over (but I’ve a tonne of posts to upload tomorrow sketched out on my laptop). However, one piece of news was announced at this week’s conference which too important to hold until the airport departure lounge….”

Telegraph.co.uk: Standard Life in call for HBOS insider trading probe

“Details of the takeover talks between Lloyds and HBOS were announced by BBC business editor Robert Peston on Wednesday morning at 9am, sending shares soaring from their low of 88p to 215p in an hour. The deal was not formally announced until four hours later. However, in two trades at 8:57am and 8:58pm, two buyers alone acquired more than 20m HBOS shares at 96p. In total, around 160m shares changed hands in the moments before the takeover was announced, making a paper profit of nearly £190m for the traders and leading to suspicion of a leak.”

b-eye.com - Business Intelligence Network - Blog: David Loshin: IDQ 2008 - Initial Observations

“As I am slowly emerging from the cocoon imposed by the needs of getting my new book on Master Data Management out the door, I am able to get back to everyday life, including two of my favorite activities (together!!) - conference attendance and blogging. Anyway, I am currently in San Antonio attending the 2008 Information and Data Quality conference.”

Data Governance and Data Quality Insider: Are There Business Advantages to Poor Data Management?

“However, this got me thinking. Could the inability for the stores to maintain more that 18 months of records actually be a business advantage? How many customers lose the paperwork, or even forget about their road hazard policies and just pay the replacement price? How much additional revenue was this shortcoming actually generating each year?”

Share This

NOTE: We apologize for our recent technical problems. They’ve been fixed, and we don’t anticipate any further disruptions.

Hub Solution Designs: August Column in DM Review

“MDM without a robust approach to data quality can be dangerous. We’ve all heard the IT cliché ‘garbage in, garbage out.’ But that is very true of building an MDM hub solution. You’re literally at the mercy of the worst data entry person in the company as you gather information from any number of source systems to feed into your new hub.”

MarketWatch: Bra thief busted

“A New York man from the regal borough of Queens was charged with selling $80,000 worth of stolen Victoria’s Secret brassieres on eBay. Over 2,000 bras ranging in value from $40 to $80 were allegedly sold by George Tutaya on the auction site. . . . The eBay aliases have since been removed but the New York Post reports that buyers were quite pleased with Tutaya’s service, which received a 100 percent approval rating.”

Confessions of a database geek: Data Quality Conference: Are you going?

“That said, if you have a strong interest in data quality, I encourage you to take a look at the conference program. Larry English and David Loshin are two of the featured speakers. (I still remember a presentation from Larry at a TDWI conference 10 years ago — he’s great.) Looking further, I see presentations ranging from metrics to politics to dictionaries.”

NOTE: We are planning on being at the conference. Let us know if you’d like to meet with us there.

The Bunker Blog: Organized Retail Theft - “Boosting For Billions” Airs On MSNBC

“On September 7th, MSNBC aired a 1-hour documentary entitled “Boosting For Billions” which took a serious look at the growing problem of Organized Retail Theft.  The program featured interviews with Jerry Biggs, ORC Division Coordinator at Walgreens, and Tony Heredia, Director, Assets Protection at Target Corporation.”

Andy on Enterprise Software: A speedy investment

“It is good to see venture firms dipping their toes back in the water of innovative enterprise software companies. A couple of years ago I came across what I thought was an interesting data quality company called Zoomix. I introduced them to a prestigious venture firm, who were entirely uninterested, at the time chasing after ever more trendy social networking websites (the company was in fact bought by Microsoft a few months ago, which would have netted a pretty decent return for the investors).”

Share This

By the Infoglide Team

Fraud, Phishing and Financial Misdeeds: Lottery Bandit Nabbed in California

“In May, alert SaveMart grocery store employees noted an individual attempting to cash in a on a winning lottery ticket reported stolen in the burglaries. . . . It’s pretty obvious that the alert employees at SaveMart were tipped off electronically that the ticket(s) being presented were ‘hot.’ . . . This isn’t the first time in recent history, the California Lottery Police have made headlines. In May, it was announced that they were using undercover agents to catch dishonest retailers, who were cheating winners out of their prizes. Winning tickets of $500 to $25,000 were presented to retailers and several of them were caught pretending the prize was smaller and keeping the proceeds for themselves. Several arrests were made throughout California as a result of the sting.”

Informatica Perspectives: Communicating the Value of Data Quality

“Many of our customers express frustration that even though it is quite obvious how their business suffers from poor data quality, they find it difficult to convince their associates to invest in initiatives that correct the problems. Earlier this year, we participated in Rob Karel’s Forrester research that addresses this issue. The resulting research paper is titled ‘A Truism for Trusted Data: Think Big, Start Small’ and its getting a lot of interest. . . . The report is available from Forrester’s web site. It contains some nice examples of how customers have built a business case for justifying investment in Data Quality.”

KRISTV.com: Squabble Heats Up Over Online Sale of Stolen Goods

“Lawmakers are pushing for a crackdown on online marketplaces, such as eBay, Yahoo, Overstock.com and others, for inadequate efforts to block the sale of stolen products on their platforms. . . . The proposed legislation is the latest skirmish in an ongoing battle over Internet intermediaries’ responsibility for their customers’ actions. Supporters of the bill want online marketplaces to more closely monitor transactions on their sites. They say the technology exists for the sites to track stolen goods sales, whether through targeting sellers who are known for proffering the products or hunting down frequently stolen goods.”

PogoWasRight.org: DHS Privacy Office - Privacy Impact Assessments

“The following Privacy Impact Assessments have been added to DHS’s site:”

Share This

[Post from Infoglide] Products, Products Everywhere and Not an Easy Way to Sync

“Product and inventory management (or Product Information Management) across an enterprise is an increasingly widespread problem. There are countless dollars being wasted on ordering, cataloging, and warehousing similar and, worse yet, duplicate parts.”

Evolution of Security: You won’t be put on a TSA “List” if you forget Your ID

“When it comes to security, identity matters. Positively identifying passengers is a critical tool in TSA’s multi-layered approach to security and one that has been bolstered significantly during the past 18 months. . . . TSA collects real-time information from airports across the country so that our operation center can look for patterns and data points of significant security value. The information is only shared with other law enforcement partners on a need-to-know basis. The ability to ‘connect the dots’ on emerging situations can not be underestimated.”

Data Governance and Data Quality Insider: The Data Intelligence Gap: Part One

“Data needs standardization, organization and intelligence, in order to provide for the business. Companies often find themselves in this position because rapid corporate growth tends to have a negative impact on data quality. As the company grows and expands new systems are put in place and new data silos form. During rapid growth, corporations rarely consider the impact of data beyond the scope of the current silo. Time marches on and the usefulness of data decays. Employee attrition leads to less and less corporate knowledge about the data, and a wider gap.”

USA Today: Private planes on TSA’s radar

“The new regulations, expected to be proposed in coming months, stop short of passenger screening, but would aim to prevent someone from flying a small plane, possibly packed with explosives, into a building. Authorities also worry about terrorists transporting hazardous materials or themselves on private aircraft, said Michal Morgan, TSA head of general aviation security.”

DataFlux Community of Experts: ‘Always On’ Data Governance - A New Era for DQ in an Event Driven World?

“I believe we need to consider the idea of ‘always on’ data quality whereby data quality ‘agents’ appear, each looking to ‘govern’ specific kinds of data to continually monitor and validate that data in the systems where it is created and also to monitor and validate it as it flows. These agents will if necessary need to analyse that data looking for data errors, incomplete information and also to check a name against a watch-list for compliance reasons for example. When these business rules are broken then action is needed to correct that data or complete it or to alert someone if a match on a watch-list occurs. Some of these corrections and completions can occur automatically and some may have to be referred to a data steward if this is not possible.”

Share This

By Neil Stickels, Infoglide Senior Solutions Architect

Product and inventory management (or Product Information Management) across an enterprise is an increasingly widespread problem. There are countless dollars being wasted on ordering, cataloging, and warehousing similar and, worse yet, duplicate parts. However, Product Information Management can be an arduous task because it involves combing through thousands, sometimes millions, of products and parts, and then grouping them appropriately. Typically this process has been a manual one, requiring thousands of hours of intensive labor by a large services organization. The cost of this type of solution is usually too large to provide an acceptable solution for small to medium-sized businesses.

A much more cost-effective solution is to create an automated way of aggregating all of the product data into a Master Product Index. To efficiently create a Master Product Index, a software solution can be used to take in the product list as well as a product taxonomy, if available. Next, the product list is classified using the taxonomy. Any products not classified result in an update to the taxonomy, and the process is repeated. This iterative process results in a Master Product List. The Master Product List is then coupled with business rules to create a Master Product Index. This Master Product Index then ties into all of the existing supply chain management services to return the most appropriate part.

Using similarity searching while performing the classification would improve the results even more. An auto-classification system using similarity searching technology applies sophisticated similarity algorithms to multiple sources of data in real time to provide not just exact matches, but similar or “fuzzy” matches as well. This approach alleviates different representations of identical data, as well as misspellings and typos that might occur during data transcription. For example, when comparing two chips, a 250 nm central processing unit produced by AMD is recognized as the same thing as a .25 µm CPU made by Advanced Micro Devices. By using similarity searching, the Master Product Index determines the closest match to a product requested, even if the exact match isn’t available.

Once the Master Product Index is created, it can be used by all facets of the supply chain management. For example, purchasing can use it in order to provide the most appropriate part number and vendor to use when ordering a given part. By coupling the Master Product List to business rules, the Master Product Index not only returns the best matching part, but also the most cost-effective part, saving costs associated with ordering duplicate parts and ensuring the best price for a part. Additionally, it can be used by an inventory system to combine inventories across multiple sites and consolidate similar groupings of products down into a single view.

Bottom line, an auto-classification system that utilizes a Master Product Index coupled with similiarity searching can efficiently solve the time- and resource-consuming problems faced within Product Information Management by providing a relatively hands-off, automated process.

Share This

By the Infoglide Team

InformationWeek: Microsoft Bolsters Data Management With Zoomix Purchase

“The Zoomix technology will eventually add functionality to the master data management technology Microsoft acquired last year when it bought Stratature and its +EDM product, according to a blog post by Microsoft group program manager Kirk Haselden, who has been leading the company’s master data management efforts. Master data management software aims to maintain a single, accurate version of data and can do things like show accumulated data on one customer from an array of data sets.”

Reuters UK: U.S. terrorism watch list tops 1 million

“About 400,000 individuals are included on the list, about 95 percent of whom are not U.S. citizens or residents, Kolton said. The watch list also includes separate entries with aliases, fake passports and fake birth dates, bringing the total number of records to more than 1 million, he said. TSA spokesman Christopher White said the agency’s ‘no-fly’ watchlists to screen travellers were ’scrubbed’ last year to remove about half of the names, leaving them with somewhat fewer than 50,000. He said Kennedy and Lewis were never on the list, and that problems they reported were due to their misidentification with names properly on it.”

NetworkWorld: Microsoft buys Zoomix to add data quality to SQL Server

“‘One of the problems we face today is that there is so much data out there, trying to figure out what’s really important — to get information, and from that information to get knowledge about what’s happening — is difficult,’ said Richard Ptak, managing partner of IT analyst firm Ptak, Noel & Associates. Vendors that provide databases, business intelligence and data-management software increasingly are integrating automated data-quality capability into those products to improve the overall quality of an organization’s data, he said.”

MarketWatch: Leading Coalition Applauds Legislation to Protect Consumers From Organized Retail Crime

“‘This new legislation is a long overdue effort to bring U.S. criminal law into the 21st century,’ said Al Thompson, vice president for global supply chain at the Retail Industry Leaders Association. ‘Organized retail crime is a serious and growing national problem. Sophisticated rings of thieves, who steal billions of dollars a year, don’t care about jeopardizing the health and safety of consumers when they sell mishandled products like diabetic test strips or over-the-counter medicines.’”

Andy on Enterprise Software: The Bulldog gets a housemate

“Microsoft generally likes to acquire software companies when they are quite small, with a dozen or two employees. In this way they can assimilate the development staff into Redmond and into the Microsoft way of doing things. . . . They opted for Zoomix, a small Israeli company which I first encountered in 2006, though they were founded in 1999. Zoomix had some quite clever marketing, claiming ’self learning’ technology as a way of making data profiling in particular more productive. In this way it could be compared to Exeros, although the technology underpinnings are quite different.”

Share This

[Post from Infoglide] Companies Just as Guilty of Workers’ Compensation Fraud as Employees

“When you hear ‘workers’ compensation fraud,’ it probably brings to mind the person who is supposed to be out with a bad back but somehow manages to do heavy yard work or play basketball while ‘injured.’ But as we’ve seen before, there’s more than one way to defraud an organization. Another kind of workers’ compensation fraud that happens more often than you might think is the type that involves employers rather than employees.”

Informatica: Microsoft Buys Zoomix

“While this is not a large transaction for Microsoft, the move does underscore the importance of Data Quality. However, this raises an interesting question. Who should you trust to deliver data quality? The people who brought you Vista? the folks who sold you SAP? At first glance, it seems quite convenient to be able to deal with data quality issues in conjunction with specific source systems. However, many IT experts would claim this approach is merely a stop-gap measure. Data must be managed apart from its host systems. Data Quality rules start to truly add value to the business when they span MS SQL Server, and SAP, and Oracle, and etc. etc. It’s still a topic of debate. But the discussion has moved beyond the question of ‘is data quality software useful?’ to ‘where is the most useful place to deliver data quality software?’”

CQ Homeland Security: States Can Fume About Real ID — or They Can Find Ways to Cope With It

“The deadline for implementing REAL ID has been extended to 2014, and so the fight between states and the Department of Homeland Security over a federally approved, state-issued identification card is cooling off, at least for the moment. That doesn’t mean states are happy about things, or that they all have backed off expressing their displeasure over what Washington is imposing on them. . . . But while the anger is understandable, it probably is time for state officials to shelve the hot rhetoric and start thinking about what to do in the next five years to get ready for REAL ID requirements, as vexing and annoying and expensive as the prospect might be. Some states already are making moves in that direction, even if they’re reluctant to acknowledge it.”

AuctionBytes Blog: eFencing Legislation Targets eBay

“eBay and retailers are about to duke it out over legislation introduced into the US House of Representatives yesterday. House Resolution 6491, the Organized Retail Crime Act of 2008, was introduced on Tuesday and was referred to the House Committee on the Judiciary. It would make organized retail crime a federal offense and would make marketplaces like eBay more accountable for stolen goods listed on their sites.”

Confessions of a database geek: Data Quality for Product Attributes: Microsoft Jumps In

“If you watch Data Quality news, or subscribe to my Information Quality aggregator, you’ll have already seen the announcement that Microsoft’s purchasing data quality vendor Zoomix. Vince McBurney and others have posted analyses of the purchase, citing Zoomix’s ability to better-position Microsoft for MDM. What caught my eye in the press release was the mention of product data quality. . . . A good deal of research has targeted how to standardize, classify, and cleanse customer/vendor names and addresses, but few have taken up the challenge for working with products.”

Evolution of Security: Myth Buster: TSA’s Watch List is More Than One Million People Strong

“FACTS ABOUT TERROR WATCH LISTS:

• Terror watch lists keep legitimate terror threats off of airplanes every day, all over the world.
• According to the Congress’ investigative arm, the Government Accountability Office, terror watch lists have, ‘helped combat terrorism’ and ‘enhanced U.S. counterterrorism effort.’
• Our partners in the law enforcement and intelligence communities work tirelessly and in some cases under great physical danger to identify individuals that pose a terror threat. The simple truth is that it would be negligent to not use this information to our advantage.”

Share This

ITBusinessEdge: The Lowdown on Master Data Management

“Master data management technologies can be a bit confusing. . . . In short, if you’re confused, don’t be surprised. MDM is complicated. Fortunately, I’ve found a very helpful free resource that sorts it all out for us.”

b-eye.com - Business Intelligence Network - Blog: David Loshin: Microsoft Buys Zoomix

“As was rumored a few weeks back (see my previous blog entry), Microsoft continues its acquisitions in the data quality/MDM arena with its announced purchase of Israeli data quality company Zoomix.”

NextGov: Federal identity programs boost biometrics market

“‘There is a little glass dome over the Washington, D.C., Beltway community,’ says Jim Harper, director of information policy studies at the Cato Institute, ‘where these contractors and security folks … are absolutely convinced of a growing and mutating and metastasizing terrorist threat–and Congress, meanwhile, has granted them tremendous amounts of money to use any way they can.’ . . . For the foreseeable future, at least, the odd bedfellows will work together. Says Harper, ‘You’ll know your privacy and liberties are relatively secure when I get back to fighting with the ACLU.’”

b-eye.com - Business Intelligence Network - Blog: James Taylor: Should Enterprise Decision Management only cover automation?

“The same reader who asked yesterday’s question had a second: Do you see the terms ‘Enterprise Decision Management‘ and ‘Smart Enough Systems’ concerned mostly with the automation of decisions — which means really only covering strictly operational and appropriate tactical decisions. The term ‘Enterprise Decision Management’ to me suggests a broader definition, one that I would expect to include the management of *all* decisions in an enterprise — operational, tactical, and strategic. I guess I see SES as a subset of EDM, but I felt like they were used as synonyms in a few places and I wasn’t sure I agreed with that usage.”

Beep: Thieves grab the oddest things

“About two-thirds of retailers identified or recovered stolen merchandise (including gift cards) being sold at swap meets, on the Internet and elsewhere, according to the National Retail Federation’s 2008 Organized Retail Crime report. A survey of senior loss prevention professionals estimated that 40 percent of the ‘new in box’ merchandise sold through auction sites was obtained fraudulently. . . . ‘It is a problem for all retailers,’ says LensCrafters’ Ingram. ‘Prices go up for consumers when there is considerable theft.’”

Share This