Helpful Talend Getting Started Guides
September 14, 2026 · Matt Irvin
Qlik Talend Cloud has a forward path for data integration and none for ESB. Here is the inventory-and-exit playbook we run on Talend Runtime estates: classify every artifact by workload type, retire the batch jobs wearing service costumes, rehost real services on Spring Boot or standalone Camel, and snapshot the container config before it disappears.
Read moreSeptember 14, 2026 · Matt Irvin
Auditors and platform teams now expect lineage for every pipeline, and Talend jobs are usually the black box in the middle. Here is how we emit OpenLineage run events from Talend, model job-to-job dependencies, add column-level mappings from tMap, and land it all in Marquez or a catalog like DataHub.
Read moreSeptember 14, 2026 · Matt Irvin
Clicking through Talend Management Console does not scale past a handful of jobs. Here is how we drive artifact promotion, task execution, and run monitoring from the Qlik Talend Cloud public API, with token handling, idempotent promotion, and alerting that actually pages the right person.
Read moreSeptember 11, 2026 · Matt Irvin
Retrieval-augmented generation is only as good as the pipeline that feeds it. A practical Talend design for crawling source documents, chunking text, calling an embeddings API in batches, and upserting vectors into Postgres pgvector idempotently — with re-embedding, cost control, and deletion handling.
Read moreSeptember 10, 2026 · Matt Irvin
The pattern we use to land Talend output in Databricks: Parquet staging in cloud storage, external locations and volumes governed by Unity Catalog, COPY INTO for the append case, and an idempotent MERGE for upserts. Plus the JDBC, auth, and cost mistakes that show up on every first cutover.
Read more