How do I optimize PI Data Archive performance?
How do I optimize PI Data Archive performance?
PI Data Archive performance depends on proper configuration of compression, archive management, and query patterns.
Compression Settings
Every PI tag has three key parameters:
Exception Deviation (ExcDev)
Filters data at the interface level before sending to PI:
- Set to the noise band of your instrument
- Too tight = too much data sent to the server
- Too loose = missing real changes
Compression Deviation (CompDev)
Filters data at the archive level:
- Typically 2x the exception deviation
- Controls what gets written to the archive files
- Most impactful setting for storage efficiency
Compression Maximum (CompMax)
Forces a write after this time period even if values haven't changed:
- Prevents "flatline" gaps in trends
- Typically set to 8 hours for process data
Archive File Management
- Keep archives on fast storage (SSD recommended for active archives)
- Set archive size between 256 MB and 1 GB
- Ensure auto-creation is enabled so you never run out of space
- Regularly check archive usage with
piartool -al
Query Optimization
- Use summary calls (average, total, count) instead of retrieving raw data
- Limit
RecordedValuescalls to reasonable time ranges - Use bulk calls when querying many tags
- Avoid open-ended queries without
maxCountlimits
Monitoring
Key performance counters to watch:
- Snapshot events/sec — rate of incoming data
- Archive events/sec — rate of data written to disk
- Queue length — pending writes (should stay near zero)
- Memory usage — PI uses memory for snapshot cache
Common Bottlenecks
| Symptom | Likely Cause |
|---|---|
| High CPU | Too many analytics or frequent queries |
| Disk I/O spikes | Archive file creation or large queries |
| Growing queue | Interface sending faster than archive can write |
| Slow queries | Missing or overly broad search criteria |
Want to ask a follow-up?
PiChat can help with your specific PI System use case. Ask follow-up questions, get code examples, and troubleshoot issues.
Related Questions
Dive Deeper
More Questions
How do I configure PI AF templates?How do I authenticate with PI Web API from Python?What's the difference between snapshot and archive values in PI?What's the difference between PI Vision and PI ProcessBook?How do I build effective PI Vision displays?What are PI Event Frames and how do I use them?How do I write PI AF Analytics expressions?How do I use PI DataLink in Excel?Should I use PI Web API or AF SDK for my application?How do I write data to PI Data Archive?What are the main components of PI System architecture?How do I set up the PI Interface for OPC DA?How do I use PI Connector for UFL to import file data?How do I set up PI Data Archive high availability with collectives?What are the security best practices for PI System?How do I migrate PI Data Archive to a new server?How do I connect Power BI to PI System?How do I manage units of measure in PI System?What's the best way to learn PI System?How does PI time syntax work?What are good PI tag naming conventions?How do I access PI System data from Java or Linux?How do I set up PI AF notification rules?How do I use batch requests in PI Web API?How do I connect to PI AF Server using AF SDK in C#?How do I write VBA macros in PI ProcessBook?How does PI data compression work?How do I get real-time streaming updates from PI Web API?How do I troubleshoot PI AF Analysis errors?How do I write SQL queries against PI using PI OLEDB?What is PI interface buffering and how do I configure it?How do I search and query PI Event Frames?What is PI Integrator for Business Analytics?How do I fix the 'Point does not exist' error in PI System?What is the difference between PI ACE and AF Analytics?How do I manually enter data into PI Data Archive?What are AF hierarchy design best practices?What is a WebID in PI Web API and how does it work?How do I configure Kerberos authentication for PI System?Can I deploy PI System in the cloud?How do I calculate summaries (average, total, min, max) in PI?What are PI digital states and how do I use them?How do I connect PI System data to Grafana?How do I backup and restore PI Data Archive?How do I create custom symbols in PI Vision?How do I automate PI System tasks with PowerShell?What is AVEVA Connect and how does it relate to PI System?How do I check and handle data quality in PI System?How do I handle pagination in PI Web API responses?How does AVEVA PI System licensing work?How do I plan a PI System upgrade?