Рассмотрим что такое Spark ML и как с ним работать.Continue reading
I haven’t had time to write to this blog in the last few years.
I was changing my specialization from IT infrastructure to Big Data.
A lot of time was spent on studying new technologies and tools.
Now I have more free time and have time to run this blog.
I will also write about Big Data. And not only in English.
When I graduated from high school, the theme of my diploma was “the Study of nonlinear dynamical systems with complex behavior”.
I wrote a C program for MS-DOS. It calculated ODE by the entered formulas, outputs a phase portrait of the system, the graphics component, their spectra, Lyapunov exponent, etc. I have used this program to study some nonlinear systems. And the first one was the Lorenz system.
It is time to create a new version based on new technologies 🙂
Extracting performance data from EMC VMAX isn’t an easy task starting Unisphere 8.
Unisphere 8 store performance in its own format – UPV. It show collected performance, but can’t read any other UPV file. If you reinstall Unisphere it will not show performance from UPV files collected before reinstallation.
Mitrend (online tool for analysing performance data) doesn’t understand UPV files. Mitrend asks for old STP format. But to collect data in that format you should setup one more server – server without Unisphere.
There is a special tool for reading UPV files – Unisphere Offline Performance Viewer. But this tool available only for EMC SPEED Gurus.
Here is a description how to extract performance data from EMC VMAX.
My VNXCollector could extract performance data from EMC CLARiiON/VNX using naviseccli. But I have added extractor for NAR files.
Here is a description why.
First, I have created a VNX Collector. Then I have created a VPLEX Collector. This systems are very similar. My next task was periodically extracting performance data from NAR files. At that moment I decided to create an universal tool to collect performance data from different storage systems with output to different collectors. Later I decide to add gathering performance data from EMC VMAX.
And now after some month of work I present Universal Storage Collector – a modular and flexible tool.