A leading brand specializing in high-quality lighting solutions, headquartered in London, was facing growing operational challenges with its data management processes. The company relies heavily on NetSuite ERP to manage its financials, procurement, and business operations, while Azure SQL Database serves as its central repository for analytics and reporting.
The existing data exchange between NetSuite and Azure SQL was managed through Azure Data Factory pipelines. However, these pipelines had a recurring issue: they expired annually, leading to frequent disruptions, downtime, and the need for manual reconfiguration. This inefficiency created risks of delayed reporting, data mismatches, and unnecessary overhead for the IT team.
To overcome these hurdles, the client partnered with ERP Peers to design and implement a long-term, stable, and secure integration solution.
Requirements
The client’s key requirements were:
- Build a scalable and future-proof integration framework between NetSuite and Azure SQL.
- Eliminate dependency on Azure Data Factory pipelines that required yearly renewal and caused downtime.
- Enable real-time or scheduled data transfer between systems for critical reporting and analytics.
- Ensure data accuracy, prevent duplicates, and minimize manual interventions.
- Incorporate a robust error-handling mechanism to provide transparency and simplify troubleshooting.
Challenge
The primary challenges identified were:
- Pipeline Dependency: The existing Azure Data Factory pipelines created a recurring disruption as they expired annually, forcing rework and system downtime.
- High Data Volumes: The client needed to handle large datasets from NetSuite efficiently without risking data loss or incomplete transfers.
- Error Visibility: The old integration framework lacked transparency, making it difficult for the client’s IT team to identify and resolve failed data transfers quickly.
- Real-Time Needs: Business-critical reports required timely data synchronization, which the existing setup could not guarantee.
Solution Delivered
ERP Peers designed and deployed a custom-built integration solution tailored to the client’s needs. The solution was developed around three core deliverables:
1. Azure Custom APIs
- Developed six secure APIs, each mapped to a specific Azure SQL table.
- Implemented authentication protocols for data security.
- Built-in pagination support to efficiently manage high-volume data transfers.
- Enhanced error resilience to ensure continuity during large or complex operations.
2. NetSuite SuiteScripts
- Designed SuiteScripts to extract data directly from NetSuite saved searches.
- Scripts transmitted data to the Azure APIs, with logic to prevent duplication and ensure data completeness.
- Provided flexibility for real-time synchronization or scheduled execution, based on business requirements.
3. Error Handling Framework
- Developed a custom error log record within NetSuite, capturing every failed transmission with detailed error codes and messages.
- Enabled the client’s internal team to track, review, and resolve issues quickly without relying on external support.
Results
The new integration framework delivered significant improvements for the client:
- Eliminated Downtime: The dependency on annually expiring pipelines was completely removed, ensuring continuous and stable operations.
- Operational Efficiency: Automated and secure data flows reduced manual intervention and saved significant IT resources.
- Improved Data Accuracy: Duplicate records and incomplete transfers were eliminated through intelligent script logic.
- Error Transparency: With the inbuilt error logging system, the IT team could proactively manage and resolve issues, enhancing system reliability.
- Scalability & Flexibility: The client now benefits from a future-ready integration framework that supports both scheduled and real-time data synchronization.
By implementing a custom-built NetSuite Azure SQL integration, ERP Peers empowered the client to achieve seamless, secure, and long-term data connectivity. The solution not only solved immediate operational challenges but also provided a scalable framework that will continue to support the client’s growing business needs without recurring disruptions.