The case is like this: A flat file of item master will be extracted daily with item code, description, and price respectively. The flat file may consists of duplicate item records which the first one is the creation of item master and the second is the updated one. I need to convert these records into XML file and only the last updated one is needed. So I need to filter the duplicate ones and get the latest ones into my XML file.
I have created a flat file schema and an XML file schema respectively on these fields. I have also created a map to link them up. An orchestration is created to receive the flat file and transform through the map and send to XML file.
Any samples and hints?