Summary
Led data optimization and compression initiatives for network operations, significantly reducing storage requirements and operational costs.
Highlights
Implemented data compression techniques, reducing Event Data Record (EDR) storage requirements by 18.2% and significantly lowering operational costs for network operators.
Optimized EDR generation through data type correction and redundancy elimination, achieving a 5.96% storage reduction.
Conducted in-depth data analysis to identify optimization opportunities, resulting in a 46% reduction in EDR file size by making obsolete DNS and ICMP records optional.
Proposed and evaluated Apache Parquet adoption, projected to save 69.88% in storage while enhancing read/write performance.