Difference between revisions of "Data Sharing Community"

From CDQ
Jump to navigation Jump to search
 
 
(330 intermediate revisions by 5 users not shown)
Line 1: Line 1:
__NOTOC__
+
<div id="mainpage">
{|
+
{| style="border-collapse:collapse; width:100%;"
|style="width:60%;vertical-align:top;padding-right:20px"|
+
 
== Corporate Data League (CDL) ==
+
| colspan="2" style="padding:0;" |
Business partner data management is heavily redundant: Many companies manage data for the same entities such as country names and codes, bill-to, ship-to, and ordering addresses, or legal hierarchies of customers and suppliers. For this reason, the [http://www.cdq.ch CC CDQ] is setting up a trusted network of user companies for sharing such data: The '''Corporate Data League''' (CDL). [https://www.corporate-data-league.ch Get a brief overview...]
+
<div class="mainpage-top">
 +
<h2> Welcome to the Portal of the CDQ Data Sharing Community</h2>
 +
<div class="content" style="text-align:center;">
 +
The CDQ Data Sharing Community is a [[Data Sharing Community Members|trusted network of user companies]] to manage [[data model|business partner data]] [[collaboration approach|collaboratively]].
 +
 
 +
<div class="portals" style="text-align:center;">
 +
{{main page topic | icon = fa-handshake-o | page = Collaboration approach | label = Collaboration}}&nbsp;&nbsp;&nbsp;&nbsp;
 +
{{main page topic | icon = fa-shield | page = Fraud protection | label = Fraud protection}}&nbsp;&nbsp;&nbsp;&nbsp;
 +
{{main page topic | icon = fa-map-o | page = Data model | label = Data model}}&nbsp;&nbsp;&nbsp;&nbsp;
 +
{{main page topic | icon = fa-desktop | page = :Category:App | label = Apps}}&nbsp;&nbsp;&nbsp;&nbsp;
 +
{{main page topic | icon = fa-cubes | page = :Category:API | label = API}}&nbsp;&nbsp;&nbsp;&nbsp;
 +
{{main page topic | icon = fa-life-ring | page = Support | label = Support}}
 +
 
 +
[[Capability/Reference Data and Metadata Management|Metadata]]&nbsp;· [[Capability/Data Quality Measurement|Data Quality Rules]]&nbsp;· [[Reference data|Data Sources]] &nbsp;· [[Data maintenance procedures|Procedures]]
 +
</div></div></div>
 +
 
 +
|-
 +
| style="padding:0; vertical-align:top; width:50%;" |
 +
<div class="mainpage-left">
 +
<h2> [[Release note|What's new?]] ({{#ask:
 +
[[Category:Release note]]
 +
 
 +
|mainlabel = Release note
 +
|?has headline = News
 +
|?has description = Description
 +
|?has release date = Release date
 +
 
 +
|sort=Has release date
 +
|order=descending
 +
|format = feed
 +
|type = rss
 +
|title = Release notes RSS
 +
|limit=100
 +
}}) </h2>
 +
<div class="content">{{#ask:
 +
[[Category:Release note]]
 +
 
 +
|mainlabel = Release note
 +
|?has headline = News
 +
|?has description = Description
 +
|?has release date = Release date
 +
|?has technical key
 +
 
 +
|sort=Has release date
 +
|order=descending
 +
|format = template
 +
|template=News list
 +
|limit=3
 +
}}<!-- --></div></div>
  
In this {{SITENAME}}, we provide information about
+
<div class="mainpage-left">
* '''Data model''': Structures, definitions, business rules. [[Data model|Read more...]]
+
<h2> [[Data Sharing|Data Sharing]] </h2>
* '''Web services''': Documentation and examples. [[Web services|Read more...]]
+
<div class="content">{{#show: collaboration approach | ? has description}}[[File:DataSharing.svg|center|thumb|600x600px|Data Sharing]]<!-- --></div></div>
* '''Reference data''': Lists of e.g. {{#ask: [[Category:Country]] | format=count }} countries and {{#ask: [[Category:Legal form]] | format=count }} legal forms. [[Reference data|Read more...]]
 
* '''Web application''': Web application to evaluate CDL functionality. [[Web application|Read more...]]
 
*'''Getting integration started''': Technical integration guideline. [[Getting integration started|Read more...]]
 
|style="vertical-align:top;"|
 
== News ==
 
{{#ask:[[Category:News item]]  
 
| ?has date =
 
| ?has summary =
 
| sort = has date
 
| order = desc
 
| format = template
 
| template = news list
 
| limit = 3
 
| searchlabel=
 
  
 +
<div class="mainpage-left">
 +
<h2>[[Data source/CDQ/data model|Data model]]</h2>
 +
<div class="content">
 +
{{#show: Data source/CDQ/data model | ? has description}}
 +
{{#ask:
 +
[[Category:data model concept]] [[Is part of::Data source/CDQ]] [[Has concept role::ROOT]] OR [[Category:data model concept]] [[Is part of::Data source/CDQ]] [[Has concept role::NODE]] [[Has parent concept.Has concept role::ROOT]]
 +
| ?Has parent concept
 +
| format = graph
 +
| nodelabel = displaytitle
 +
| graphlink = yes
 +
| graphsize = 6
 +
| graphname = datamodel
 
}}
 
}}
{{#ask:[[Category:News item]]  
+
<!-- -->
| ?has date =  
+
</div></div>
  | ?has summary =
+
 
  | sort = has date
+
<div class="mainpage-left">
  | order = desc
+
<h2> [[Data maintenance procedures]] </h2>
  | limit = 0
+
<div class="content">
| searchlabel=''View older news &hellip;''
+
{{#show: Data maintenance procedures | ? has description}} Try
}}
+
* {{#queryformlink:form=Country procedure|link text=CH ({{#show: Address/country/CH | ?Has monolingual name.Text }})|link type=link|query string=Country procedure[country]=Address/country/CH}},
 +
* {{#queryformlink:form=Country procedure|link text=DE ({{#show: Address/country/DE | ?Has monolingual name.Text }})|link type=link|query string=Country procedure[country]=Address/country/DE}},
 +
* {{#queryformlink:form=Country procedure|link text=PL ({{#show: Address/country/PL | ?Has monolingual name.Text }})|link type=link|query string=Country procedure[country]=Address/country/PL}},
 +
* {{#queryformlink:form=Country procedure|link text=US ({{#show: Address/country/US | ?Has monolingual name.Text }})|link type=link|query string=Country procedure[country]=Address/country/US}},
 +
 
 +
or select another country from the list.
 +
</div></div>
 +
 
 +
<div class="mainpage-left">
 +
<h2> [[:Category:App|CDQ Apps]] </h2>
 +
<div class="content">
 +
{{#show: Category:App | ? has description}}
 +
<div style="width:600px">{{#ask: [[Category:App]]
 +
  | ?Has image
 +
  | format=gallery
 +
  | imageproperty = Has image
 +
  | widget = carousel
 +
}}</div></div></div>
  
News reader integration: {{#ask:[[Category:News item]]
+
<div class="mainpage-left">
  | sort = has date
+
<h2> [[:Category:API|CDQ API]]  </h2>
| order = desc
+
<div class="content">{{#show: Category:API | ? has description}}
| format = feed
+
{{#ask: [[Category:API]] [[Has short description::+]]
| searchlabel = RSS
+
  | ?Has short description=
| title = Corporate Data League –- News
+
  | format = ul
| description = Latest news from the Corporate Data League
 
}} · {{#ask:[[Category:News item]]
 
  | sort = has date
 
| order = desc
 
  | format = feed
 
| type = atom
 
| page = full
 
| searchlabel = Atom
 
| title = Corporate Data League -– News
 
| description = Latest news from the Corporate Data League
 
 
}}
 
}}
|}
+
</div></div>
  
== CTI Funding ==
+
| style="padding:0; vertical-align:top; width:50%;" |
[[File:LogoCTI.png|thumb|300px|link=https://www.kti.admin.ch/kti/en/home.html|Commission for Technology and Innovation]] The Corporate Data League (CDL) was started from a research and development project that was funded by the [https://www.kti.admin.ch/kti/en/home.html Commission for Technology and Innovation (CTI)] in 2014. In another running research project, the CDL team elaborates new ways for data validation with [[business rules]] together with researches from the [http://www.iwi.unisg.ch Institute of Information Management] at the [http://www.unisg.ch University of St. Gallen]. Also these activities are funded by the CTI until June 2016.
 
  
== Data Model ==
+
<div class="mainpage-right">
<!--[[File:Data model digraph CDLModel dot.png|right|thumb|300px]]-->
+
<h2> [[Product feature/Capabilities and Features|Capabilities of CDQ Cloud Services]] </h2>
A common understanding of shared data is a mandatory prerequisite for cross-corporate data management. For the Corporate Data League, the [[data model|CDL data model]] specifies this common understanding. Currently, the following {{#ask: [[Category:data model attribute]] | format=count }} [[:Category:data model attribute|attributes]] are documented. [[Web services|Read more...]]
+
<div class="content">
{{#ask: [[Category:data model attribute]]
+
{{#show: Product feature/Capabilities and Features | ? has description}}
| mainlabel = Concepts
+
{{Template:Product capability map}}
| ?Is part of = Entity
+
</div></div>
| ?Has definition = Definition
 
| limit = 5
 
}}
 
  
== Business Rules ==
+
<div class="mainpage-right">
To ensure data quality, {{#ask: [[Category:business rule]] | format=count }} [[business rules]] are defined. The following rules are currently implemented using semantic web technology:
+
<h2> [[Data sources]] </h2>
{{#ask: [[Category:business rule]]
+
<div class="content">
  | mainlabel = Business Rule
+
{|
  | ?Has formalized representation=Definition
+
| style="vertical-align:top; width:300px; padding: 0;" |{{#ask:[[Category:Data source]] [[Release status::7]] [[Has number of records::+]]  
  | limit = 5
+
  | mainlabel = Active data sources
 +
  | ?Has number of records = Records
 +
| sort = Has number of records
 +
| order = desc
 +
  | limit=8
 
}}
 
}}
 +
| style="vertical-align:top; padding-top: 8px;" |{{#show: reference data | ? has description}}
 +
|}
 +
</div></div>
  
== Web Services ==
+
<div class="mainpage-right">
From an integration perspective, CDL [[web services]] are the most important component of the CDL infrastructure. They provide the technical link between your business applications and the CDL cloud services. We follow the [[wikipedia:REST|REST]] design principle for web services which allows for lightweight interface design and easy integration. Of course, all web services are also available at [[wikipedia:WSDL|WSDL]] interfaces. Currently, we provide the following {{#ask: [[Category:Web service]] | format=count}} [[web services]]. [[Web services|Read more...]]
+
<h2> [[Business rules|Business rules]] </h2>
{{#ask: [[Category:Web service]]
+
<div class="content">
| mainlabel=Web service
+
{{Map/data quality rules}}
| ? Web service category=Category
+
{{#show: Data quality rules | ?has description }}</div></div>
| ? Has description = Description
 
| sort=Web service category
 
| limit=5
 
}}
 
  
== Reference Data ==
+
<div class="mainpage-right">
The Corporate Data League uses a collaboratively managed [[reference data|reference data repository]] for data validation. Currently,
+
<h2> [[Fraud protection|Fraud protection]]</h2>
* {{#ask: [[Category:Country]] | format=count }} countries (e.g. {{#ask: [[Category:Country]] | format=list | limit=10 | order=random | searchlabel= }}) and
+
<div class="content">
* {{#ask: [[Category:Legal form]] | format=count }} legal forms (e.g. {{#ask: [[Category:Legal form]] | format=list | limit=10 | order=random | searchlabel= }})
+
[[File:fraud-protection-whitelist-approach.png|left|thumb|200px|Bank account whitelist]]
are maintained. [[Reference data|Read more...]]
+
{{#show: fraud protection | ? has description}}
 +
</div></div>
  
== Web Application ==
+
|}
[[File:DemoApplication.png|right|thumb|400px]]
+
</div>__NOTOC__ __NOEDITSECTION__
The [[web application|CDL web application]] provides access to all functionality of the CDL cloud infrastructure such as
 
* [[Web application for data cleansing|data cleansing]],
 
* [[Web application for duplicate analysis|duplicate analysis]] and
 
* [[Web application for banking data fraud management|banking data fraud management]].
 
'''Enjoy testing, and please [[Contact|let us know]] about your feedback!'''
 

Latest revision as of 10:46, 12 July 2021

Welcome to the Portal of the CDQ Data Sharing Community

The CDQ Data Sharing Community is a trusted network of user companies to manage business partner data collaboratively.

  Collaboration       Fraud protection       CDQ data model       Apps       API       Support

Metadata · Data Quality Rules · Data Sources  · Procedures

What's new? (RSS)

In-App tutorials (23 July 2021)

In-App tutorials have been introduced for currently two apps. Tutorials for all other apps will follow soon. These so called app-tours allow for understanding the basic functionalities and required inputs of the CDQ Cloud Apps.

Additional data quality rules available for testing (23 July 2021)

The data quality rulebook was extended by a number of data quality rules. The rules are currently available in HYPERCARE status and can be tested.

Identification of old post code formats


Checkdigit checks for business identifiers


Format checks for identifiers

Business Partner Lookup enriched by a new data source from the USA (23 July 2021)

Our BP Lookup service has been connected to a new data source - Internal Revenue Service, which offers data of over 1,7 million of organizations from the United States of America.

... further results

Data Sharing

Business partner data management is heavily redundant: Many companies manage data for the same entities such as country names and codes, bill-to, ship-to, and ordering addresses, or legal hierarchies of customers and suppliers. The CDQ collaboration approach is based on a trusted network of user companies that share and collaborativelay maintain this data.
Data Sharing

Data model

An important prerequisite for collaborative data management is a common understanding of the shared data. For the CDQ Data Sharing Community, this common understanding is specified by the CDQ Data Model. The concepts of this model are defined and documented in this wiki which can be used as a business vocabulary. Moreover, the wiki provides a machine-readable interface to reuse this metadata by using semantic annotations.

AddressBusiness partnerBank accountFraud caseBusiness partner/relationBusiness partner/nameBusiness partner/partner profileBusiness partner/relation/classBusiness partner/statusBusiness partner/identifierFraud case/fraudsterBusiness partner/legal formThis is a graph with borders and nodes that may contain hyperlinks.

Data maintenance procedures

A procedure is a common standard or "how-to" for a specific data management task. Within the CDQ Data Sharing Community, companies agree on such procedures to ensure similar rules and guidelines for similar tasks. For several countries, the CDQ Wiki provides such information, e.g. data quality rules, trusted information sources, legal forms, or tax numbers. Try

or select another country from the list.

CDQ Apps

Web applications, also called CDQ Apps, to access certain features for demonstration purposes and to configure certain features which are provided then via APIs directly.

CDQ API

From an integration perspective, CDQ web services are the most important component of the CDQ infrastructure. They provide the technical link between your business applications and the CDQ cloud services. We follow the REST design principle for web services which allows for lightweight interface design and easy integration. Of course, all web services are also available at WSDL interfaces.
  • Data Exchange API (Services to upload, manipulate, and download businesspartner data in the CDL Cloud.)
  • Bankaccount Data API (Services to validate and to confirm bank account data, and to manage payment fraud cases.)
  • Data Compliance API (Services to search and read compliance information.)
  • Data Curation API (Services to curate and enrich business partner and address data.)
  • Data Matching API (Services to maintain matching definition used as configuration for matching jobs and services to match data with a job.)
  • Data Validation API (Services to validate businesspartners and identifiers.)
  • Referencedata API (Services to search and read reference data.)

Data sources

Active data sourcesRecords
Data source VIES50,000,000
Data source BR.RF46,535,779
Data source FR.RC31,387,469
Data source DE.RC6,108,555
Data source GB-EAW.CR5,453,725
Data source JP.CR5,018,138
Data source US-FL.BER3,838,903
Data source PL.NOBR3,461,846
... further results
The CDQ Data Sharing Community uses a collaboratively managed reference data repository. This incorporates the integration of external data sources for enriching or validating business partner and address data. Examples of available data sources are 316 countries (e.g. AT (Österreich, Austria, Autriche, 奥地利), BE (Belgien, Belgium, Belgique, België, 比利时), DE (Deutschland, Germany, Allemagne, 德国)), 949 legal forms (e.g. ), and 40 active business partner data sources (e.g. Data source EE.CR, Data source DNB, Data source CH.UIDR).

Capability/Data Quality Measurement

Transformation of human-documented data requirements into executable data quality rules is mostly a manual IT effort. Changing requirements cause IT efforts again and again. Some checks, e.g. tax number validity (not just format!), require external services. Other checks, e.g. validity of legal forms, require managed reference data (e.g. legal forms by country, plus abbreviations). Continuous data quality assurance (i.e. batch analyses) and real-time checks in workflows often use different rule sets. Data requirements and related reference data are collected and updated collaboratively by the Data Sharing Community. Data quality rules are derived from these requirements automatically, auditor approved. All data quality rules are executed behind 1 interface, in real-time, 1’000+ rules in < 1s. Batch jobs and single-record checks use the same rule set and can be integrated by APIs. If reference data (e.g. correct tax numbers) is available, fix proposals are provided for incorrect records.

Fraud protection

Bank account whitelist

Companies are facing an ever increasing number of digitized frauds, meanwhile on a very professional level. Among other types, falsified invoices are causing significant financial damage, in some cases more than 1 Mio. USD by just one attack. One critical challenge to uncover those fraud attacks is to identify bank accounts (e.g. given by an invoice) which are not owned by the declared business partner (e.g. the supplier of an invoice) but by a third party, i.e. the attacker. The CDQ Data Sharing community is addressing this challenge by sharing information on known fraud cases and on proven bank accounts. The Fraud Case Database comprises known fraud cases, shared by community members. Other members can lookup these cases by bank account data (e.g. IBAN) to automate screening for critical accounts. On the other hand, the Whitelist comprises bank accounts which are declared "save" by community members. You can lookup shared Trust Scores to check a new bank account and to ensure that this account is already used by another member.