Oracle Data Integrator Concepts

ODI  High Level Objectives:

Ø  Overview of the architecture of the complete Oracle Data Integrator system

Ø  Define the Information System architecture

Ø  Get started with projects in Oracle Data Integrator and release your work for deployment

Ø  An overview of models, reverse-engineering model metadata from your database, and how and why to flesh out models with missing metadata

Ø  Manage metadata in Oracle Data Integrator: models and data quality

Ø  Create simple interfaces and add multiple sources to an interface

Ø  Launch a session to run an interface

Ø  Enforce data quality constraints in an interface

Ø  Manage packages

Ø  Add more advanced integration components

Ø  Customize data flow and get the best performance out of your system

Ø  An overview of sessions, use Operator to monitor, stop and start sessions, and basic troubleshooting.

Introduction : 

Ø  Identifying the Course Content

Ø  What is Oracle Data Integrator?

Ø  Why Oracle Data Integrator?

Ø  Overview of ODI 11g Architecture

Ø  Overview of ODI 11g Components

Ø  About Graphical Modules

Ø  Types of ODI Agents

Ø  Overview of Oracle Data Integrator Repositories

Installations & Configurations :

Ø  Oracle 11G Database.

Ø  ODI 11G

Ø  Weblogic Server 11G

Ø  Configurations

Administering ODI Repositories and Agents :

Ø  Administrating the ODI Repositories

Ø  Creating Repository Storage Spaces

Ø  Creating and Connecting to the Master Repository

Ø  Creating and Connecting to the Work Repository

Ø  Managing ODI Agents

Ø  Creating a Physical Agent

Ø  Launching a Listener, Scheduler and Web Agent

Ø  Example of Load Balancing

ODI Topology Concepts :  

Ø  Overview of ODI Topology

Ø  About Data Servers and Physical Schemas

Ø  Defining the Physical Architecture

Ø  Defining the Logical Architecture

Ø  Mapping Logical and Physical Resources

Ø  Defining Agents

Ø  Defining a Topology

Ø  Planning the Topology

Describing the Physical and Logical Architecture : 

Ø  Overview of Topology Navigator

Ø  Creating Physical Architecture

Ø  Creating a Data Server

Ø  Testing a Data Server Connection

Ø  Creating a Physical Schema

Ø  Creating Logical Architecture

Ø  Overview of Logical Architecture and Context Views

Ø  Linking the Logical and Physical Architecture

Setting Up a New ODI Project :

Ø  Overview of ODI Projects

Ø  Creating a New Project

Ø  Using Folders

Ø  Organizing Projects and Folders

Ø  Understanding Knowledge Modules

Ø  Exchanging ODI Objects

Ø  Exporting and Importing Objects

Ø  Using Markers

Oracle Data Integrator Model Concepts :  

Ø  What is a Model?

Ø  Understanding Metadata in ODI

Ø  Understanding Reverse Engineering

Ø  Creating Models

Ø  Organizing Models

Ø  Creating Data stores

Ø  Using Constraints in ODI

Ø  Creating Keys and References

Organizing ODI Models and Creating Data stores : 

Ø  What is an Interface?

Ø  Business Rules for Interfaces

Ø  What is a Mapping?

Ø  What is a Join?

Ø  What is a Filter?

Ø  What is a Constraint?

Ø  What is a Staging Area?

Ø  Creating a Basic Interface

ODI Interface Concepts  : 

Ø  What is an Interface?

Ø  Business Rules for Interfaces

Ø  What is a Mapping, Filter, Join?

Ø  Overview of Integration Process

Ø  What is a Staging Area?

Ø  About Execution Location

Ø  Using Knowledge Modules (KM) with ODI Interface

Ø  Creating a Basic Interface

Designing Interfaces :

Ø  Designing an Interface

Ø  Multiple Source Data stores

Ø  Creating Joins

Ø  Filtering data

Ø  Disabling Transformations

Ø  Overview of the Flow

Ø  Specifying the Staging Area

Ø  Selecting Knowledge Modules

Interfaces: Monitoring and Debugging :

Ø  Monitoring Interfaces

Ø  Using Operator

Ø  Viewing Sessions and Tasks

Ø  How to Monitor Execution of an Interface

Ø  How to Troubleshoot a Session

Ø  Keys to Reviewing the Generated Code

Ø  Working with Errors

Ø  Tips for Preventing Errors

Designing Interfaces: Advanced Topics : 

Ø  Using Business Rules in Interfaces

Ø  Overview of Business Rule Elements

Ø  Using variables

Ø  Using User Functions

Ø  Using Substitution Methods

Ø  Modifying a KM

Ø  Developing Your Own KM

Ø  Using RKM for Customized Reverse Engineering

Using ODI procedures : 

Ø  What is a Procedure?

Ø  Examples of Procedures

Ø  Creating Procedures

Ø  Adding Commands

Ø  Adding Options

Ø  Running a Procedure

Ø  Using Operator to View Results

Using ODI Packages : 

Ø  What is a package?

Ø  Creating a package

Ø  Executing a package

Ø  Creating Advanced Packages

Ø  Error handling

Ø  Controlling an Execution Path

Ø  Creating a Loop

Ø  Using the Advanced tab

Managing ODI Scenarios and Versions : 

Ø  What is a Scenario?

Ø  Managing Scenarios

Ø  Preparing Scenarios for Deployment

Ø  Automating Scenario Management

Ø  Scheduling the ODI Scenario

Ø  Overview of ODI version management

Ø  Using Version Browser and Version Comparison Tool

Ø  Handling concurrent changes

Enforcing Data Quality and Auditing Data with ODI :

Ø  Why Data Quality?

Ø  When to Enforce Data Quality?

Ø  Data Quality in Source Applications

Ø  Data Quality Control in the Integration Process

Ø  Data Quality in the Target Applications

Ø  Enforcing Data Quality

Ø  Exploring Your Data

Ø  Auditing Data Quality

Working with Changed Data Capture : 

Ø  Overview of ODI version management

Ø  Techniques of Changed Data Capture

Ø  Changed Data Capture in ODI

Ø  CDC Strategies and Infrastructure

Ø  CDC Consistency

Ø  Using CDC

Ø  Viewing Data/Changed data

Ø  Using Journalizing

Administering ODI Resources: Advanced Topics :

Ø  Using Open Tools

Ø  Installing Open Tools

Ø  Using Open Tools in a Package

Ø  Using Open Tools in a Procedure or in a KM

Ø  Developing Your Own Open Tools

Ø  Setting Up ODI Security

Ø  Defining Security Policies

Ø  Defining Password Policies

Datawarehousing Concepts

Datawarehousing Concepts:

Ø  Physical and Logical Data modeling

Ø  Creating Physical tables and schemas

Ø  Creating Oracle Queries

Ø  Data base installations

Ø  Dataware house concepts

Ø  Star Schema , Snowflake Schema and Galaxy Schema

Ø  SCD Types  ( slowly changing dimentions)

Ø  Dimentional modeling

Ø  Data modeling

Ø  ODI Installations

Ø  Weblogic Installations and configurations

Ø  Oracle Data Integrator 11G New Features Overview

Oracle Data Integrator Interview Questions and Answers

1. what is load plans and types of load plans?
ANS) Load plan is a process to run or execute multiple scenarios as a Sequential or parallel or conditional based execution of your scenarios. And same we can call three types of load plans , Sequential, parallel and Condition based load plans.
2. what is profile in odi?
ANS)  profile is a set of objective wise privileges. we can assign this profiles to the users. Users will get the privileges from profile. Please refer http://oditraining.blogspot.co.uk/2012/06/odi-security-manager-all-profiles.html


3 what is the odi console?
ANS) ODI console is a web based navigator to access the Designer, Operator and Topology components through browser.

4.how to write the sub queries in odi?
ANS:)Using Yellow interface and sub queries option we can create sub queries in odi.
or Using  VIEW we can go for sub queries Or Using ODI Procedure we can call direct DB queries
in ODI.

5.suppose i having 6 interfaces and running the interface 3 rd one failed how to run remaining interfaces?
ANS: ) if you are running Sequential load it will stop the other interfaces. so goto operator and right click on filed interface and click on restart. If you are running all the interfaces are parallel only one interface will fail and other interfaces will finish.

6. how to remove the duplicate in odi?
ANS) Use DISTINCT in IKM level. it will remove the duplicate rows while loading into target.

7. suppose having unique and duplicate but i want to load unique record one table and duplicates one table?
ANS) Create two interfaces or once procedure and use two queries one for Unique values and one for duplicate values.

8. how to write the procedures in odi?
ANS) Procedure is a step by step any technology code operations . you can refer


 

Oracle Data Integrator Interview questions and Answers

1)how to implement the logic in procedures if the source side data deleted that will reflect the target side table
ANS)User this query on Command on target Delete from Target_table where not exists (Select 'X' From Source_table Where Source_table.ID=Target_table.ID).

2)if the src hav total 15 records with 2 records are updated and 3 records are newly inserted at the target side we have to load the newly changed and inserted records
ANS) Use IKM Incremental Update Knowledge Module for Both Insert n Update operations.

3)can we implement package in package?
ANS:) Yes we can call one package into other package.

4)how to load the data with one flat file and one rdbms table using joins?
ANS:) Drog n drop both File and table into source area and join as in Staging area.

5)in the package one interface got failed how to know which interface got failed if we no access to operator?
ANS:)Make it mail alert or check into SNP_SESS_LOg tables for session log details.

6)if the src and tgt are oracle technology tell me the process to achieve this requirement(interfaces,kms,models)
ANS) Use LKM SQL to SQL or LKM SQL to Oracle , IKM Oracle Incremental update or Control append.

7)how to implement data validations?
ANS:) Use Filters & Mapping Area AND DataQuality related to constraints use CKM Flowcontrol.

8)how to handle exceptions?
ANS) Exceptions In packages advanced tab and load plan exception tab we can handle exceptions.

9)what we specify the in xml dataserver and parameters for to connect to xml file?
ANS:) Filename with location :F and Schema :S this two parameters

10)how to implement cdc
ANS) CDC is a step by step process please refer.  http://oditraining.blogspot.in/2012/09/cdc-changed-data-capture-in-odi-step-by.html

11)how to reverse engineer views(how to load the data from views)?
ANS) In Models Goto Reverse engineering tab and select Reverse engineering object as
VIEW.



12) What is Start Schema and Snowflake Schema?
Please refer DWH Concepts. http://oditraining.blogspot.in/2012/07/data-ware-housing-concepts-with.html

find the files more than 30 days linux / unix

Finding files more than 30 days.

find . -type f -mtime +30

Finding all directories more than 30 days

find . -type d -mtime +30


Find the all files more than 30 days with size gb

find . -type f -mtime +30  | df -g

Find all files more than 30 days  and delete

find . -type f -mtime +30 | | xargs rm

ODI 11.1.1.7 version require jdk1.6.0_24 version and higher versions( JDK1.7)

ODI 11.1.1.7 version require jdk1.6.0_24 version and higher versions( JDK1.7 we can use this but oracle not yet certified and right click wont work in ODI Studio ). It won't support for jdk1.6.0_23 and lower version.

ODI 11G 11.1.1.7 New Feature WebSphere integration....

Unix VI Editor commands

START VI EDITTOR
----------------
     vi filename     edit filename starting at line 1
      vi -r filename     recover filename that was being edited when system crashed
   
EXIT VI
--------
    :x<Return>     quit vi, writing out modified file to file named in original invocation
      :wq<Return>     quit vi, writing out modified file to file named in original invocation
      :q<Return>     quit (or exit) vi
     :q!<Return>     quit vi even though latest changes have not been saved for this vi call

MOVING THE CURSOR:
-----------------
    j or <Return>
  [or down-arrow]     move cursor down one line
     k [or up-arrow]     move cursor up one line
     h or <Backspace>
  [or left-arrow]     move cursor left one character
     l or <Space>
  [or right-arrow]     move cursor right one character
     0 (zero)     move cursor to start of current line (the one with the cursor)
     $     move cursor to end of current line
      w     move cursor to beginning of next word
      b     move cursor back to beginning of preceding word
      :0<Return> or 1G     move cursor to first line in file
      :n<Return> or nG     move cursor to line n
      :$<Return> or G     move cursor to last line in file
   
SCREEN MANIPULATION:
-------------------
     ^f     move forward one screen
      ^b     move backward one screen
      ^d     move down (forward) one half screen
      ^u     move up (back) one half screen
      ^l     redraws the screen
      ^r     redraws the screen, removing deleted lines
   
UNDO:
-----
    u     UNDO WHATEVER YOU JUST DIDA
   
INSERTING OR ADDING TEXT:
------------------------

    i     insert text before cursor, until <Esc> hit
      I     insert text at beginning of current line, until <Esc> hit
     a     append text after cursor, until <Esc> hit
      A     append text to end of current line, until <Esc> hit
     o     open and put text in a new line below current line, until <Esc> hit
     O     open and put text in a new line above current line, until <Esc> hit
   
CHANGING TEXT:
--------------
    r     replace single character under cursor (no <Esc> needed)
      R     replace characters, starting with current cursor position, until <Esc> hit
      cw     change the current word with new text,
        starting with the character under cursor, until <Esc> hit
      cNw     change N words beginning with character under cursor, until <Esc> hit;
  e.g., c5w changes 5 words
      C     change (replace) the characters in the current line, until <Esc> hit
      cc     change (replace) the entire current line, stopping when <Esc> is hit
      Ncc or cNc     change (replace) the next N lines, starting with the current line,
        stopping when <Esc> is hit   
       
DELETING TEXT:
--------------

    x     delete single character under cursor
      Nx     delete N characters, starting with character under cursor
      dw     delete the single word beginning with character under cursor
      dNw     delete N words beginning with character under cursor;
  e.g., d5w deletes 5 words
      D     delete the remainder of the line, starting with current cursor position
     dd     delete entire current line
      Ndd or dNd     delete N lines, beginning with the current line;
  e.g., 5dd deletes 5 lines

CUT & PASTE:
-----------
    yy     copy (yank, cut) the current line into the buffer
      Nyy or yNy     copy (yank, cut) the next N lines, including the current line, into the buffer
      p     put (paste) the line(s) in the buffer into the text after the current line 
   
SEARCHING STRING:
-----------------   
    /string     search forward for occurrence of string in text
      ?string     search backward for occurrence of string in text
      n     move to next occurrence of search string
      N     move to next occurrence of search string in opposite direction
 
DELETING LINE NUMBERS:
----------------------

    :.=     returns line number of current line at bottom of screen
      :=     returns the total number of lines at bottom of screen
      ^g     provides the current line number, along with the total number of lines,
        in the file at the bottom of the screen
       
SAVING & READING FILES:
-----------------------
    :r filename<Return>     read file named filename and insert after current line
        (the line with cursor)
      :w<Return>     write current contents to file named in original vi call
      :w newfile<Return>     write current contents to a new file named newfile
      :12,35w smallfile<Return>     write the contents of the lines numbered 12 through 35 to a new file named smallfile
      :w! prevfile<Return>     write current contents over a pre-existing file named prevfile
   
MOVING THE CURSOR:
-----------------
    h    left one space       
    l    right one space
    j    down one space       
    k    up one space

UNIX CRONTAB Commands

CRONTAB COMMANDS:
-----------------
crontab -l                 #Lists the contents of your current crontab file
crontab -e                 #Edits your current crontab file (when the file saved, the cron daemon is automatically refreshed.)
crontab -r                 #Removes your crontab file from the crontab directory
crontab -v                 #check crontab submission time
crontab mycronfile         #submit your crontab file to /var/spool/cron/crontabs directory

crontab file format:
minute    hour    day_of_month    month        weekday        command
0-59      0-23    1-31            1-12        0-6 Sun-Sat     shell command

* * * * * /bin/script.sh        #schedule a job to run every minute
0 1 15 * * /fullbackup          #1 am on the 15th of every month
0 0 * * 1-5 /usr/sbin/backup    #start the backup command at midnight, Mo - Fr
0,15,30,45 6-17 * * 1-5 /home/script1    #execute script1 every 15 minutes between 6AM and 5PM, Mo - Fr