Technimove’s first objectives were to implement and test Veeam platform. In order to deliver this, GAIN Capital supplied a 64-bit Windows 2016 R2 server environment as well as providing all IP addresses for Veeam, access to the VMware environment and administrator access to the Veeam server.
Technimove was responsible for the following actions to implement the Veeam platform:
The 2nd objective was to test the Veeam Implementation, Technimove was responsible for the following actions to test Veeam:
Once the implementation of the platform, testing and acceptance criteria was met, this enabled Technimove to use this platform to migrate the GAIN Capital’s virtual machines.
Technimove were now at the stage of the project where the necessary pre-requisites have been completed and implemented. This meant the Migration work packages could now commence.
The first work package was to deliver the Physical to Virtual Migration (P2V). Technimove’s objective was to virtualise 5 physical servers on the new VSAN platform, and to ensure all VMs are migrated/accessible from new infrastructure.
In order to deliver the above, Technimove were responsible for the following actions:
- Test local account/domain account access to the physical server which are in scope for migration.
- Install the latest version of VMware Converter
- Complete the VMs migration readiness
- Migrate the servers to the new environment
- Application shutdown (completed by Stakeholders)
- Power off from the existing infrastructure
- Power on the VM from new infrastructure and test the VM access
- Install latest VMware tools and confirm that virtual machines hardware level is at a pre-agreed value during the time of migration
Virtual to Virtual Migrations – V2V
Stage 4 of the delivery was to complete the Virtual to Virtual Migrations (V2V). This involved migrating 250 virtual servers on the new VSAN platform, hosted across two SuperMicro devices.
GAIN Capital provided remote login details to Technimove. Once retrieved, the following actions were to be completed by Technimove:
- Test local account/domain account access to the virtual server which are in scope for migration.
- Application shutdown and complete power down of the VM’s from the existing environment
- Final replication sync
- Power on from for the new infrastructure
- Test the VM access
- Install latest VMware tools and confirm that virtual machine’s hardware level is at a pre-agreed value during the time of migration
- Clean up the old drivers
During the course of the Migration, Technimove faced a series of challenges. The issues started to arise after completing 80 virtual migrations onto the new platform. Circa 20 VMs failed because of disk failure errors. Due to ongoing issues, a rollback had to be invoked. Technimove and GAIN Capital commenced the troubleshooting to discover the root of the problem. It became apparent that GAIN Capital received a faulty batch of hard drives, which ultimately caused the virtual migrations to fail. As a result of faulty drives, this also initiated software problems on the SuperMicro devices.
There was a 4-week lead time to retrieve replacement hard drives and to fix the software issues. However, because of the time constraints of the project it was decided to approach the re-seller to obtain two new units, as they could be delivered within a week.
Once the new units were delivered, it took a weekend to configure and prepare the devices. Upon completion of the preparation work, it was decided to leave the units to run for a further two days to ensure no software or hardware errors re-occurred.
Completing the above steps meant that the remaining 170 virtual migrations could now re-commence and were successfully completed across 4 days.
Physical Server and Storage Migration to Interxion
Upon completion of all virtual migrations, the project was now approaching its final stages.
Technimove’s objective, was to relocate the reduced footprint of GAIN Capital’s infrastructure of 90 devices, from Park House to Interxion Data Centre. However, due to the COVID-19 pandemic and ensuing government-imposed lockdown, the migration was postponed.
Once the lockdown measures were eased, Technimove and GAIN Capital could re-schedule the migration. Technimove’s Project Manager had scheduled the Migration to be completed across 4 days, Friday to Monday. Tuesday was added within the migration plan as a contingency measure. This was in order to follow the government’s guidelines whilst keeping all onsite personnel safe.
Technimove’s scope was to perform the following:
- Pre/post-checks and power off/on all HPE 3PAR equipment
- Shutdown/power on all server and storage equipment, as per shutdown scripts and power down/up sequence
- Provide a network resource onsite to assist GAIN Capital during network testing
- De-Cable, De-Rack, package equipment, transport, Re-Rack and Re-Cable all 90 devices in scope.
On the first day of the Migration, Technimove allocated two teams; a power down and migration team. The power down team was first to arrive onsite, they had an 8 hour window to gracefully shutdown all servers, storage and 3PAR devices.
The migration team arrived 1 hour prior to the completion of shutdown. Upon the migration team’s arrival, engineers began by preparing all packaging material required for the Migration. The migration team lead then liaised with the team lead in charge of the shutdown to ensure completion, ahead of commencing work. Once confirmed, the migration team commenced the decommission and labelling of all devices required to be migrated in line with the equipment list.
Equipment was de-racked before being individually wrapped in anti-static bubble wrap and placed into purpose built, foam lined, server flight cases.
All rail kits associated with the migration were labelled in line with the destination rack plans before being de-mounted and placed into purpose built, foam lined, rail kit flight cases.
Upon completion of the de-installation, Technimove’s team lead performed a walk round with the customer along with an equipment list, to perform final checks that all devices in scope have been removed.
Flight cases were secured and security sealed in Technimove’s Mercedes GPS Tracked, solid sided vehicles.
The pre-fuelled vehicles travelled directly to the destination site at Interxion, where the Technimove team unloaded flight cases and moved them into position within the new facility.
Technimove commenced breaking the security tags and seals. All rail kits were unpacked and installed as per the rack designs. After rail kits were installed and flight cases were brought into the DC room, the team reached a milestone and then ceased works. The team ensured all devices were secured within GAIN Capital’s DC environment, signed off and left site until the next day.
On the second day the install re-commenced, the migration team signed in at Interxion, gained access into GAIN Capital’s DC hall and commenced the re-racking of devices as per the rack designs.
The challenge for the re-racking was due to the government COVID-19 guidelines. Technimove had a reduced team onsite and there were 5 HP C7000 devices to re-rack mid height. To assist the team with this challenge, Technimove utilised mechanical Genie Lifts, which enabled a safe install.
The other challenge the team had were that a percentage of the remaining server equipment were originally racked on faulty or missing rails. Technimove bring 0u shelves on every migration as a best practice measure for this type of occasion. This enabled the team to install the devices without rail kits successfully.
During these works, Technimove had supplied a network resource onsite at Interxion. The engineer assisted GAIN Capital to test the network.
Upon completion of the re-racking, the migration team hit the milestone required for this day. The team lead signed off with the customer and left site.
On the third day the re-commissioning work commenced. All devices were patched in line with the patching schedule. There were circa 550 x network cables to patch. It was imperative that the patching was completed with accuracy. To ensure there were no mispatches, the team would work in pairs to patch, review and sanity check the cabling.
The team had reached the third day’s milestone. Upon completion the team lead notified the client and Technimove’s Project Manager of work completed and signed off.
The migration was now on the final fourth day. Technimove had a power up team attend site along with our Post- Commissioning team, who completed the physical migration.
Technimove followed a power up sequence and script for all servers. However, there was an issue with the network connectivity and the credentials for logins would not work. There was also a fault with one of the ILO management ports on a C7000 device. After troubleshooting with GAIN Capital regarding the network connectivity and login, it was decided to reset the credentials and re-start the configuration process again. The C7000 was under warranty, so HP sent out an engineer within the same day to fix the faulty ILO management port.
The above issues caused a 6 hour delay, which meant that the fifth contingency day included would be needed. However, due to Technimove’s flexibility, additional resources were allocated on the fourth day to power up all critical services ahead of the fifth day to give re-assurance.
This meant minimal work was left on the contingency day, all remaining servers were powered on by Technimove. Upon completion, the team leader reported back to the client and Technimove’s Project Manager, before providing a sign off of the service.
Technimove’s final stage was to provide ITAD services to assist with the dilapidation of the Park House comms room. Technimove removed all server, storage network devices marked for De-commission, and the associated racks and cabling.
Once all items had been received by the recycling warehouse and given their unique reference number, the disposal team audited each item and recorded their details (make, model, serial number, asset number and unique reference number) on an electronic report. Once all the items’ details had been recorded, the team immediately removed any magnetic or solid-state hard drives and checked for any other data carrying media. The media then entered Technimove’s data suite for sanitisation as per our data capability statement.
Technimove offered two levels of software overwriting solutions. Hard Disk Manager Software can be used, which meets US DoD 5220.22-M overwriting standards or industry leading CESG certified (on magnetic hard drives) Blancco Software.
All hard drives that were collected are wiped as standard, whether Technimove are told if they contain data or not. The official standard to which Technimove wipe hard drives is ‘British HMG Infosec Standard No: 5 (Enhanced)’.
During the hard drive overwriting process, both software solutions kept a log of start time of the write, along with the date, size of hard drive, serial number of hard drive and completion time and date. The software verified the wipe and the method used and this will be stated in a report at the end of the wipe. In the extremely rare event that a hard drive failed to wipe correctly, this hard drive was then physically destroyed.
Once all items had been fully disposed of, a certificate was raised which stated the following information:
- Address collected from
- Date items were collected
- Address items were items were disposed at
- Date items were disposed of
- Number of hard drives destroyed (if any) and whether this was on or offsite
- Full audit of the equipment including make, model, serial number, asset number and number of hard drives.
This certificate, along with the collection note, hard drive wiping report (where applicable) and waste transfer note was then sent to the nominated project leader. All documents will be kept on record for future reference for up to 3 years. Should the client require copies of any documentation, a written request is to be sent to Technimove.