TAILAR: Database Development and Utilities, Slides of Applications of Computer Sciences

The development of various features and functions for the tailar system, including anonymization, etl, analytics and reporting, database utilities, and implementation architecture. It includes details on specific functions, ui and bll implementations, sql queries, and database schema design.

Typology: Slides

2011/2012

Uploaded on 07/16/2012

samderiya
samderiya 🇮🇳

4.3

(4)

62 documents

1 / 64

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
1
Layout
TAILAR- Introduction
TAILAR Work breakdown
TAILAR Architecture
TAILAR Deployment Architecture
TAILAR Data
Anonymization & ETL (briefly)
Analytics & Reporting Details
Analytics & Reporting Implementation
Database Utilities
Utilities Implementation
Conclusion
Possible Future Extensions
docsity.com
pf3
pf4
pf5
pf8
pf9
pfa
pfd
pfe
pff
pf12
pf13
pf14
pf15
pf16
pf17
pf18
pf19
pf1a
pf1b
pf1c
pf1d
pf1e
pf1f
pf20
pf21
pf22
pf23
pf24
pf25
pf26
pf27
pf28
pf29
pf2a
pf2b
pf2c
pf2d
pf2e
pf2f
pf30
pf31
pf32
pf33
pf34
pf35
pf36
pf37
pf38
pf39
pf3a
pf3b
pf3c
pf3d
pf3e
pf3f
pf40

Partial preview of the text

Download TAILAR: Database Development and Utilities and more Slides Applications of Computer Sciences in PDF only on Docsity!

Layout

 TAILAR- Introduction

 TAILAR Work breakdown

 TAILAR Architecture

 TAILAR Deployment Architecture

 TAILAR Data

 Anonymization & ETL (briefly)

 Analytics & Reporting Details

 Analytics & Reporting Implementation

 Database Utilities

 Utilities Implementation

 Conclusion

 Possible Future Extensions

TAILAR- Introduction

• Data Anonymization de-identifies the confidential information and

creates a realistic database copy that is still fully functional and no

longer vulnerable.

• Migration (ETL) refers to shifting data from one source object to a

target object where both source and target could be of different

architectures.

• Usage Analytics & Reporting refers to capacity planning and

analyzing database usage and growth over a period of time with tabular

and graphical reports for analysis.

• Database Utilities facilitate the user by providing functionalities

including complete DB exploration, backup, similarity test, conversion

guides etc.

TAILAR Implementation Architecture

Architectural Diagram

Data Access Logic Component

Presentation Layer Data Access Layer Data

Data Access Helper Component

Business Entity ApplicationTAILAR^ accesses User Interface

Business Logic Layer

PROCESSING LOGIC

verifyCredentials()

getUserPassword() (^) getData() getDataLogic{openCon; closeCon;}

Teradata Server

SQL Server

TAILAR Application

TAILAR Deployment Architecture

Hardware/Software

Specs

  • 2 GHZ Processor
    • 2 GB RAM -1 GB App Folder
  • .Net Framework v2.
  • Teradata 12.
  • SQL Server 2005

Anonymization and ETL Functions Developed

Feature (^) UI Functions BLL Functions DAHC Functions

Anonymization AnonymizableFields( );

GetDataSet( ); BeginAnonymization( ); PopulateDatabases( ); AnonymizePhone( ); AnonymizePostalCode( ); AnonymizeDOB( ); AnonymizeAddress( ); PopulateDatabases( ); PopulateTables( ); PopulateColumns( );

GetDatabases( ); GetTables( ); GetColumns( ); GetAttributes( );

GetDatabases( ); GetTables( ); GetColumns( ); GetAttributes( );

Feature (^) UI Functions BLL Functions DAHC Functions

ETL ExtractData( );

InitialExtraction( ); FullExtract( ); SplitterTransformation( ); JoinerTranformation( ); Load( );

GetDatabases( ); GetTables( ); Extract( ); Transform( ); Load( );

GetDatabases( ); GetTables( ); Extract( ); Transform( ); Load( );

Analytics & Reporting Functions Developed

Feature UI Functions BLL Functions DAHC Functions

Analytics &

Reporting

PopulateSystemDbInfo_TD( ); GetDrives( ); PopulateDbInfo( ); PopulateTableUsageInfo( ); PopulateTableUsageInfo( ); PopulateSystemDbInfo( ); PopulateDatabases( ); CalculateCapacity( ); CreateSystemChart( ); CreateDatabaseChart( ); PopulateDbInfo( ); PopulateDbUsedSizes( ); PopulateDbFreeSpace( ); PopulateUsedFreeDbSpace_TD( );

GetDatabases( ); GetSystemDbInfo( ); GetDbInfo( ); GetDbUsedSizes( ); PopulateUsedFreeDbSpace_TD( ); GetSystemDbInfo_TD( ); CalculateCapacity( ); getUnUsedSpace( );

GetDatabases( ); GetSystemDbInfo( ); GetDbInfo( ); GetDbUsedSizes( ); PopulateUsedFreeDbSpace_TD( ); GetSystemDbInfo_TD( ); CalculateCapacity( ); getUnUsedSpace( );

Database Utilities Functions Developed

Feature UI Functions BLL Functions DAHC Functions

Db Similarity

Test

PopulateDatabases( ); GetTableCount( ); GetRowCount( );

GetTableCount( ); GetRowCount( ); GetDatabases( );

GetTableCount( ); GetRowCount( ); GetDatabases( );

Db Explorer

& backup

Utility

GetDatabases( ); GetDbObjectGroups( ); GetDbObjects( ); GetBackup( ); ConnectToSqlServer( ); GetData( );

GetDbObjects( ); GetDbObjectGroups( ); GetData( );

GetDbObjects( ); GetDbObjectGroups( ); GetData( );

TAILAR Common Classes Developed

Class Functions

Tailar App

Common

DbServerConnectionString( ); Tailar DbAgent( ); GetDataReader( ); GetDataSet( );

Util DbConnectionSetting( );

writeConfig( ); getConnectionStrings( ); extractSettingInfo( ); ConvertProviderName( ); ReverseConvertProviderName( );

Login GetServerTypes( );

DisplayMenu( ); ClearConnectionControls( );

Anonymization

• Anonymization is the way that prevents the leakage of confidential

information in the data that is publicly available.

• The data itself might seem anonymous but when paired with other existing

data, re-identification becomes possible.

• Anonymization ensures that the identity of any individual will not be

discovered even when the available data is paired with some existing

information about the individual.

TAILAR Anonymization

• Quasi Identifiers – Identity leaking attributes

TAILAR ETL

1. Extraction

Full Extraction: Extract whole dataset every time

Incremental Extraction: Restrict the data to be extracted on the basis of identity

column

2. Transformations

Different types of generic and specific transformations are carried out including

Splitter, Joiner, Pass Through.

3. Loading

Initial Load is carried out by transferring all data to the target.

Incremental Load transfers the data in several increments based on the

criterion.

TAILAR Login Screen

Server Type

Connection Name

User Id

Password

Data Source

Login Details-Code Fragments

Reference: 84_Util

Login Details-Code Fragments

Reference: 84_Util