Рассмотрим что такое Spark ML и как с ним работать.
Continue readingHello again
I haven’t had time to write to this blog in the last few years.
I was changing my specialization from IT infrastructure to Big Data.
A lot of time was spent on studying new technologies and tools.
Now I have more free time and have time to run this blog.
I will also write about Big Data. And not only in English.
Lorenz system in R
When I graduated from high school, the theme of my diploma was “the Study of nonlinear dynamical systems with complex behavior”.
I wrote a C program for MS-DOS. It calculated ODE by the entered formulas, outputs a phase portrait of the system, the graphics component, their spectra, Lyapunov exponent, etc. I have used this program to study some nonlinear systems. And the first one was the Lorenz system.
It is time to create a new version based on new technologies 🙂
Extracting Performance Data from IBM Storwize
Universal Storage Collector could extract performance data not only from EMC Storage Systems 🙂
New Extractor extracts data from IBM Storwize storage family.
Extracting performance data from EMC RecoverPoint
One more Extractor for Universal Storage Collector. It extract performance data from EMC RecoverPoint.
Extracting performance data from EMC VMAX
Extracting performance data from EMC VMAX isn’t an easy task starting Unisphere 8.
Unisphere 8 store performance in its own format – UPV. It show collected performance, but can’t read any other UPV file. If you reinstall Unisphere it will not show performance from UPV files collected before reinstallation.
Mitrend (online tool for analysing performance data) doesn’t understand UPV files. Mitrend asks for old STP format. But to collect data in that format you should setup one more server – server without Unisphere.
There is a special tool for reading UPV files – Unisphere Offline Performance Viewer. But this tool available only for EMC SPEED Gurus.
Here is a description how to extract performance data from EMC VMAX.
Extracting data from NAR files
My VNXCollector could extract performance data from EMC CLARiiON/VNX using naviseccli. But I have added extractor for NAR files.
Here is a description why.
Universal Storage Collector
First, I have created a VNX Collector. Then I have created a VPLEX Collector. This systems are very similar. My next task was periodically extracting performance data from NAR files. At that moment I decided to create an universal tool to collect performance data from different storage systems with output to different collectors. Later I decide to add gathering performance data from EMC VMAX.
And now after some month of work I present Universal Storage Collector – a modular and flexible tool.
New Year, New Christmas Tree
Running FreeBSD 11 on Raspberry Pi
FreeBSD 11 was released recently. I ran pre-released FreeBSD 11 on Raspberry Pi already. And I have noted that it behaviour changes from snapshot to snapshot.
Let’s see how released FreeBSD 11 works on Raspberry Pi Model B.