faizan mohammed
faizan mohammed

Reputation: 11

Writing to two different tables by Wrapping data from Processor Spring Batch

I have a requirement where I need to populate two different tables using two different Objects. I am wrapping (List and List) into CustEmp Object but I am unable to figure out on how to use CompositeItemWriter to write it using separate data sources. Please help

I have updated with code, unfortunately due to some reasons I cant upload the exact code. Please let me know if its not clear. I have found a similar question here but not able to figure out the unwrapping part in the writer : Use Spring Batch to write in different Data Sources

RecordsDomain.java

public class RecordsDomain{
private List<XYRecords> xyRecords;
private YZRecords yzRecords;

//getters & setters

}

ProcessorDomain.java - BASED ON NEW REQUIREMENTS

    @Configuration
 public class DomainProcessor implements ItemProcessor<InputDomain, RecordsDomain> {

    
    @Override
    public DomainProcessor process(InputDomain input) throws Exception {
        RecordsDomain allRecords = new RecordsDomain();
        //Processing logic- listXyRecords is of type List<XYRecords> 
         and yxRecords is of type YXRecords, I am setting both in 
        RecordsDomain//
        dtrRecords.setXyRecords(listXyRecords);
        dtrRecords.setYzRecords(yzRecords);
         return dtrRecords;
    }

}

DomainWriter.java

@Configuration
public class DomainWriter {
 //CURRENTLY I have a Writer which unpacks and inserts/update a table based off List<XYRecords>. I need to add another writer which updates based off YZRecords. How do i go about that.//
    @Autowired
    DataSource dataSource;
    public ItemWriter<List<XYRecords>> writer() throws Exception {
        ListUnpackingItemWriter<XYRecords> listUnpackingItemWriter = new ListUnpackingItemWriter<>();
        listUnpackingItemWriter.setDelegate(itemWriter());
        return listUnpackingItemWriter;
    }
 

    public CompositeItemWriter<XYRecords> itemWriter() throws Exception {
            CompositeItemWriter<XYRecords> itemWriter = new CompositeItemWriter<>();
            ClassifierCompositeItemWriter<XYRecords> classifierCompositeItemWriter = getDataItemWriters(
                    insertItemWriter(), updateItemWriter());        
            itemWriter.setDelegates(Arrays.asList(classifierCompositeItemWriter));
            itemWriter.afterPropertiesSet();
            return itemWriter;
        }

    public JdbcBatchItemWriter<XYRecords> insertItemWriter() {
            JdbcBatchItemWriter<XYRecords> itemWriter = new JdbcBatchItemWriter<>();
            itemWriter.setDataSource(dataSource);
            itemWriter.setAssertUpdates(false);
            itemWriter.setSql("INSERT QUERY");
            ItemPreparedStatementSetter<XYRecords> setterStatus = new InsertPreparedStatementSetter();
            itemWriter.setItemPreparedStatementSetter(setterStatus);
            return itemWriter;
        }
    
    public JdbcBatchItemWriter<XYRecords> updateItemWriter() {
            JdbcBatchItemWriter<XYRecords> itemWriter = new JdbcBatchItemWriter<>();
            itemWriter.setDataSource(dataSource);
            itemWriter.setAssertUpdates(false);
            itemWriter.setSql("UPDATE QUERY");
            ItemPreparedStatementSetter<XYRecords> setterStatus = new UpdatePreparedStatementSetter();
            itemWriter.setItemPreparedStatementSetter(setterStatus);
            return itemWriter;
        }
    private ClassifierCompositeItemWriter<XYRecords> getDataItemWriters(
                ItemWriter<XYRecords> insertItemWriter,
                ItemWriter<XYRecords> updateItemWriter) {
            ClassifierCompositeItemWriter<XYRecords> classifierCompositeItemWriter = new ClassifierCompositeItemWriter<>();
            classifierCompositeItemWriter
                    .setClassifier((Classifier<XYRecords, ItemWriter<? super XYRecords>>) XYRecords-> {
                        if ("Check if qualifies to update the table") {
                            return updateItemWriter;
    
                        } else {
                            CompositeItemWriter<XYRecords> compositeItemWriter=new CompositeItemWriter<>();
                            compositeItemWriter.setDelegates(Arrays.asList(insertItemWriter,updateItemWriter));
                            return compositeItemWriter;
                        }
    
                    });
            return classifierCompositeItemWriter;
        }

}

Upvotes: 1

Views: 1153

Answers (1)

Mahmoud Ben Hassine
Mahmoud Ben Hassine

Reputation: 31600

You are returning a composite item writer for the "insert" case here:

private ClassifierCompositeItemWriter<XYRecords> getDataItemWriters(
            ItemWriter<XYRecords> insertItemWriter,
            ItemWriter<XYRecords> updateItemWriter) {
        ClassifierCompositeItemWriter<XYRecords> classifierCompositeItemWriter = new ClassifierCompositeItemWriter<>();
        classifierCompositeItemWriter
                .setClassifier((Classifier<XYRecords, ItemWriter<? super XYRecords>>) XYRecords-> {
                    if ("Check if qualifies to update the table") {
                        return updateItemWriter;

                    } else {
                        CompositeItemWriter<XYRecords> compositeItemWriter=new CompositeItemWriter<>();
                        compositeItemWriter.setDelegates(Arrays.asList(insertItemWriter,updateItemWriter));
                        return compositeItemWriter;
                    }

                });
        return classifierCompositeItemWriter;
    }

I think this should be something like:

private ClassifierCompositeItemWriter<XYRecords> getDataItemWriters(
            ItemWriter<XYRecords> insertItemWriter,
            ItemWriter<XYRecords> updateItemWriter) {
        ClassifierCompositeItemWriter<XYRecords> classifierCompositeItemWriter = new ClassifierCompositeItemWriter<>();
        classifierCompositeItemWriter
                .setClassifier((Classifier<XYRecords, ItemWriter<? super XYRecords>>) XYRecords-> {
                    if ("Check if qualifies to update the table") {
                        return updateItemWriter;

                    } else { // insert case
                        return insertItemWriter;;
                    }

                });
        return classifierCompositeItemWriter;
    }

Upvotes: 0

Related Questions