Wednesday, July 24, 2013

Oracle Data Integrator Concepts



ODI  High Level Objectives:
Ø  Overview of the architecture of the complete Oracle Data Integrator system
Ø  Define the Information System architecture
Ø  Get started with projects in Oracle Data Integrator and release your work for deployment
Ø  An overview of models, reverse-engineering model metadata from your database, and how and why to flesh out models with missing metadata
Ø  Manage metadata in Oracle Data Integrator: models and data quality
Ø  Create simple interfaces and add multiple sources to an interface
Ø  Launch a session to run an interface
Ø  Enforce data quality constraints in an interface
Ø  Manage packages
Ø  Add more advanced integration components
Ø  Customize data flow and get the best performance out of your system
Ø  An overview of sessions, use Operator to monitor, stop and start sessions, and basic troubleshooting.
Introduction : 
Ø  Identifying the Course Content
Ø  What is Oracle Data Integrator?
Ø  Why Oracle Data Integrator?
Ø  Overview of ODI 11g Architecture
Ø  Overview of ODI 11g Components
Ø  About Graphical Modules
Ø  Types of ODI Agents
Ø  Overview of Oracle Data Integrator Repositories
Installations & Configurations :
Ø  Oracle 11G Database.
Ø  ODI 11G
Ø  Weblogic Server 11G
Ø  Configurations
Administering ODI Repositories and Agents :
Ø  Administrating the ODI Repositories
Ø  Creating Repository Storage Spaces
Ø  Creating and Connecting to the Master Repository
Ø  Creating and Connecting to the Work Repository
Ø  Managing ODI Agents
Ø  Creating a Physical Agent
Ø  Launching a Listener, Scheduler and Web Agent

Ø  Example of Load Balancing
ODI Topology Concepts :  
Ø  Overview of ODI Topology
Ø  About Data Servers and Physical Schemas
Ø  Defining the Physical Architecture
Ø  Defining the Logical Architecture
Ø  Mapping Logical and Physical Resources
Ø  Defining Agents
Ø  Defining a Topology
Ø  Planning the Topology
Describing the Physical and Logical Architecture : 
Ø  Overview of Topology Navigator
Ø  Creating Physical Architecture
Ø  Creating a Data Server
Ø  Testing a Data Server Connection
Ø  Creating a Physical Schema
Ø  Creating Logical Architecture
Ø  Overview of Logical Architecture and Context Views
Ø  Linking the Logical and Physical Architecture
Setting Up a New ODI Project :
Ø  Overview of ODI Projects
Ø  Creating a New Project
Ø  Using Folders
Ø  Organizing Projects and Folders
Ø  Understanding Knowledge Modules
Ø  Exchanging ODI Objects
Ø  Exporting and Importing Objects
Ø  Using Markers
Oracle Data Integrator Model Concepts :  
Ø  What is a Model?
Ø  Understanding Metadata in ODI
Ø  Understanding Reverse Engineering
Ø  Creating Models
Ø  Organizing Models
Ø  Creating Data stores
Ø  Using Constraints in ODI
Ø  Creating Keys and References
Organizing ODI Models and Creating Data stores : 
Ø  What is an Interface?
Ø  Business Rules for Interfaces
Ø  What is a Mapping?
Ø  What is a Join?
Ø  What is a Filter?
Ø  What is a Constraint?
Ø  What is a Staging Area?
Ø  Creating a Basic Interface
ODI Interface Concepts  : 
Ø  What is an Interface?
Ø  Business Rules for Interfaces
Ø  What is a Mapping, Filter, Join?
Ø  Overview of Integration Process
Ø  What is a Staging Area?
Ø  About Execution Location
Ø  Using Knowledge Modules (KM) with ODI Interface
Ø  Creating a Basic Interface
Designing Interfaces :
Ø  Designing an Interface
Ø  Multiple Source Data stores
Ø  Creating Joins
Ø  Filtering data
Ø  Disabling Transformations
Ø  Overview of the Flow
Ø  Specifying the Staging Area
Ø  Selecting Knowledge Modules
Interfaces: Monitoring and Debugging :
Ø  Monitoring Interfaces
Ø  Using Operator
Ø  Viewing Sessions and Tasks
Ø  How to Monitor Execution of an Interface
Ø  How to Troubleshoot a Session
Ø  Keys to Reviewing the Generated Code
Ø  Working with Errors
Ø  Tips for Preventing Errors
Designing Interfaces: Advanced Topics : 
Ø  Using Business Rules in Interfaces
Ø  Overview of Business Rule Elements
Ø  Using variables
Ø  Using User Functions
Ø  Using Substitution Methods
Ø  Modifying a KM
Ø  Developing Your Own KM
Ø  Using RKM for Customized Reverse Engineering
Using ODI procedures : 
Ø  What is a Procedure?
Ø  Examples of Procedures
Ø  Creating Procedures
Ø  Adding Commands
Ø  Adding Options
Ø  Running a Procedure
Ø  Using Operator to View Results
Using ODI Packages : 
Ø  What is a package?
Ø  Creating a package
Ø  Executing a package
Ø  Creating Advanced Packages
Ø  Error handling
Ø  Controlling an Execution Path
Ø  Creating a Loop
Ø  Using the Advanced tab
Managing ODI Scenarios and Versions : 
Ø  What is a Scenario?
Ø  Managing Scenarios
Ø  Preparing Scenarios for Deployment
Ø  Automating Scenario Management
Ø  Scheduling the ODI Scenario
Ø  Overview of ODI version management
Ø  Using Version Browser and Version Comparison Tool
Ø  Handling concurrent changes
Enforcing Data Quality and Auditing Data with ODI :
Ø  Why Data Quality?
Ø  When to Enforce Data Quality?
Ø  Data Quality in Source Applications
Ø  Data Quality Control in the Integration Process
Ø  Data Quality in the Target Applications
Ø  Enforcing Data Quality
Ø  Exploring Your Data
Ø  Auditing Data Quality
Working with Changed Data Capture : 
Ø  Overview of ODI version management
Ø  Techniques of Changed Data Capture
Ø  Changed Data Capture in ODI
Ø  CDC Strategies and Infrastructure
Ø  CDC Consistency
Ø  Using CDC
Ø  Viewing Data/Changed data
Ø  Using Journalizing
Administering ODI Resources: Advanced Topics :
Ø  Using Open Tools
Ø  Installing Open Tools
Ø  Using Open Tools in a Package
Ø  Using Open Tools in a Procedure or in a KM
Ø  Developing Your Own Open Tools
Ø  Setting Up ODI Security
Ø  Defining Security Policies
Ø  Defining Password Policies

Datawarehousing Concepts

Datawarehousing Concepts:
Ø  Physical and Logical Data modeling
Ø  Creating Physical tables and schemas
Ø  Creating Oracle Queries
Ø  Data base installations
Ø  Dataware house concepts
Ø  Star Schema , Snowflake Schema and Galaxy Schema
Ø  SCD Types  ( slowly changing dimentions)
Ø  Dimentional modeling
Ø  Data modeling
Ø  ODI Installations
Ø  Weblogic Installations and configurations
Ø  Oracle Data Integrator 11G New Features Overview

Tuesday, July 23, 2013

Oracle Data Integrator Interview Questions and Answers

1. what is load plans and types of load plans?
ANS) Load plan is a process to run or execute multiple scenarios as a Sequential or parallel or conditional based execution of your scenarios. And same we can call three types of load plans , Sequential, parallel and Condition based load plans.
2. what is profile in odi?
ANS)  profile is a set of objective wise privileges. we can assign this profiles to the users. Users will get the privileges from profile. Please refer http://oditraining.blogspot.co.uk/2012/06/odi-security-manager-all-profiles.html


3 what is the odi console?
ANS) ODI console is a web based navigator to access the Designer, Operator and Topology components through browser.

4.how to write the sub queries in odi?
ANS:)Using Yellow interface and sub queries option we can create sub queries in odi.
or Using  VIEW we can go for sub queries Or Using ODI Procedure we can call direct DB queries
in ODI.

5.suppose i having 6 interfaces and running the interface 3 rd one failed how to run remaining interfaces?
ANS: ) if you are running Sequential load it will stop the other interfaces. so goto operator and right click on filed interface and click on restart. If you are running all the interfaces are parallel only one interface will fail and other interfaces will finish.

6. how to remove the duplicate in odi?
ANS) Use DISTINCT in IKM level. it will remove the duplicate rows while loading into target.

7. suppose having unique and duplicate but i want to load unique record one table and duplicates one table?
ANS) Create two interfaces or once procedure and use two queries one for Unique values and one for duplicate values.

8. how to write the procedures in odi?
ANS) Procedure is a step by step any technology code operations . you can refer


 

Oracle Data Integrator Interview questions and Answers

1)how to implement the logic in procedures if the source side data deleted that will reflect the target side table
ANS)User this query on Command on target Delete from Target_table where not exists (Select 'X' From Source_table Where Source_table.ID=Target_table.ID).

2)if the src hav total 15 records with 2 records are updated and 3 records are newly inserted at the target side we have to load the newly changed and inserted records
ANS) Use IKM Incremental Update Knowledge Module for Both Insert n Update operations.

3)can we implement package in package?
ANS:) Yes we can call one package into other package.

4)how to load the data with one flat file and one rdbms table using joins?
ANS:) Drog n drop both File and table into source area and join as in Staging area.

5)in the package one interface got failed how to know which interface got failed if we no access to operator?
ANS:)Make it mail alert or check into SNP_SESS_LOg tables for session log details.

6)if the src and tgt are oracle technology tell me the process to achieve this requirement(interfaces,kms,models)
ANS) Use LKM SQL to SQL or LKM SQL to Oracle , IKM Oracle Incremental update or Control append.

7)how to implement data validations?
ANS:) Use Filters & Mapping Area AND DataQuality related to constraints use CKM Flowcontrol.

8)how to handle exceptions?
ANS) Exceptions In packages advanced tab and load plan exception tab we can handle exceptions.

9)what we specify the in xml dataserver and parameters for to connect to xml file?
ANS:) Filename with location :F and Schema :S this two parameters

10)how to implement cdc
ANS) CDC is a step by step process please refer.  http://oditraining.blogspot.in/2012/09/cdc-changed-data-capture-in-odi-step-by.html

11)how to reverse engineer views(how to load the data from views)?
ANS) In Models Goto Reverse engineering tab and select Reverse engineering object as
VIEW.



12) What is Start Schema and Snowflake Schema?
Please refer DWH Concepts. http://oditraining.blogspot.in/2012/07/data-ware-housing-concepts-with.html

Tuesday, July 16, 2013

find the files more than 30 days linux / unix

Finding files more than 30 days.

find . -type f -mtime +30

Finding all directories more than 30 days

find . -type d -mtime +30


Find the all files more than 30 days with size gb

find . -type f -mtime +30  | df -g

Find all files more than 30 days  and delete

find . -type f -mtime +30 | | xargs rm