The Definitive Guide to Turning your Business and Data Center into an AI Factory
- Details
- Written by Octavian Tanase
AI factories and foundries moved into the popular lexicon when Nvidia CEO Jensen Huang used these terms in his recent keynote address. Traditionally, foundries transform raw materials into basic components, and factories assemble products.
But AI factories and foundries are a new way to approach product creation and innovation – and they are poised to fundamentally change software development, the resources they consume and how they can be managed.
That is altering how businesses operate and increasing the value that they create and deliver.
Here's how.
AI and generative AI (GenAI) provide opportunities for companies inside and out
Companies are beginning to leverage GenAI across Canada, especially in companies with more than 100 employees to create more value, not to replace jobs. The technology, professional services, scientific, technical services, and finance sectors lead the race in Gen AI adoption.
These businesses see the value of GenAI: ~69% of businesses that are using or planning to use the technology see its value in accelerating creative content development, ~46% in increased automation without job loss, ~36% in customer experience improvements, and ~35% in cost reduction. Only ~13% of businesses plan on using GenAI to displace employees.
For example, Hitachi Vantara is using GenAI copilots and large language models (LLMs) to assist its customer service, marketing and sales teams. Joint research from MIT and Stanford indicates that GenAI can enable customer support agents to resolve 14% more issues per hour – and shows that GenAI drove productivity improvements of 34% for new and lower-skilled workers.
GenAI and AI are also changing the way software is built and how it works. Software engineers can become a lot more productive with a GenAI assist. McKinsey research indicates that with the help of GenAI, software developers can document code functionality for maintainability (which considers how easily code can be improved) in half the time, write new code in nearly half the time and optimize existing code (called code refactoring) in nearly two-thirds the time. Wealthsimple uses GenAI to become more agile by reducing delivery times associated with traditional machine learning. They also leverage the technology for call centre productivity gains. These improvements enable staff to focus on spotting errors to ensure answers are as accurate as possible.
Companies are also starting to embed AI and machine learning (ML) into the software they build, enabling businesses to make better decisions based on a dynamic understanding of the customer and use case rather than static heuristics.
As organizations adopt and expand their use of GenAI and use more software with built-in AI and ML, they will want to consider how to prepare their IT infrastructure so they have the underlying power and flexibility they need. This presents an opportunity for organizations to upgrade and modernize their infrastructure in collaboration with trusted partners.
No one company will own everything needed to make AI and GenAI efforts a success
A lot of underlying hardware and software is needed to power AI and GenAI so companies can use these technologies to meet their goals. That creates the need to establish highly integrated processes throughout the product lifecycle and in the way that companies run their businesses.
Businesses and their key partners must ensure that they and every vendor in their supply chains comply with all relevant requirements, and enforce best practices that fit the model of the company that is deploying AI. That includes following the right processes and having checks and balances on the materials they use, their manufacturing processes, the way they design software, and how they transport and deliver solutions. Alignment and tight integration are especially critical with GenAI, which requires significant compute and storage resources and, if left unchecked, can lead to runaway compute costs, power usage and carbon emissions.
A recent media report notes that one version of a single Nvidia Blackwell chip for data center use draws 1,200 watts of electricity, “an insane amount of power compared to just a few years ago.” GenAI, and the AI foundries and factories that enable GenAI applications, will need to rely on lots of compute, interconnect networks and storage to link the massive datasets to the compute. That means organizations also need optimization to ensure timely delivery while reducing gas consumption and costs and limiting carbon emissions.
Consider this as your company embraces GenAI and turns its own business into an AI factory
Look at AI as a workload (or, to be specific, a suite of workloads), but understand that GenAI creates different workloads than companies have seen in the past. We are all learning about GenAI as we go, but one thing is clear: the way that organizations form their infrastructure around these new workloads must change, and putting the right infrastructure in place is not a trivial task. A big chunk of that infrastructure will be in the cloud, but on-premises infrastructure also has a role to play. Deciding on and building the most appropriate systems in the cloud and on prem to optimize efficiency will require a lot of analysis and expertise, so collaborate with partners that can position your GenAI efforts for success today and in the future. Partners that are innovative and have proven their expertise in deploying and running mission-critical infrastructure will empower you to get the greatest value from GenAI.
Understand there are no quick answers; optimizing GenAI is an iterative process. Embrace solutions that simplify infrastructure and automation and partners that have the capability to help you with everything from data preparation (which includes removing unnecessary data and obfuscating sensitive data) to bringing data together on scalable, flexible and cost-effective data storage, to AI model training, to interference. Seek trusted partners with deep experience in your business vertical, familiarity with local legislation (including Bill C-27 AIDA), and with the kind of data-centric workflows you will be working with.
Remember that AI and GenAI are all about data. So be sure you have the most relevant and complete data as well as the right data infrastructure to locate, secure and safeguard your data.
With the right approach and data infrastructure behind your GenAI and AI efforts, your business can become an AI factory of sorts, using software to optimize operations, differentiate offerings and drive business growth securely.
Octavian Tanase is chief product officer at Hitachi Vantara, which is transforming the way data fuels innovation. A wholly owned subsidiary of Hitachi Ltd., Hitachi Vantara provides the data foundation the world’s leading innovators rely on. Through data storage, infrastructure systems, cloud management and digital expertise, the company helps customers build the foundation for sustainable business growth.
Past Attendees
ADP - VP Architecture & Infrastructure
AESO - VP, Information Technology
Agnico Eagle Mines - VP, IT
Agrium - Global Mgr., IT Security
Agrium - Senior Director IT Shared Services
Aimia - SVP & Global CIO
Ainsworth Engineered - Director IT
Air Canada Vacations - Director IT
Alberta Energy Regulator - Director, Office of the CIO
Anthem Properties - VP IS
AON Risk Solutions Canada - Head of IT
Avison Young - VP Global Enterprise Architecture & Integration
Aviva Canada - VP, Architecture & Strategy
Bank of America Merrill Lynch - CTO
BC Ferry Services - VP & CIO
Bell Business Markets - Director, Strategy & Planning
Bell Canada - National Director, Digital Transformation
Bellatrix Exploration - Director, Information Technology
Bentall Kennedy - VP IT
BFL CANADA - CIO
BFL CANADA - Director, Cybersecurity & IT Risk Management
Black Press - CTO
BlackBerry - VP Corporate IT
BMO Financial Group - Director, Technology & Operations Transformation
BMO Financial Group - Head of Services Delivery
Bombardier Aerospace - CISO
Bonavista Petroleum - Head of IT
Borden Ladner Gervais LLP - Global CIO
Bow Valley College - Director, IT Services
Bridgewater Bank - Head of IT
BuildDirect - VP IT
Bulk Barn - Head, IT
Burnco - CIO
Caisse de Depot et Placement du Quebec - VP, IT Planning, Architecture, Governance, Operations
Calfrac Well Services - Head of IT
Canada Goose - CTO
Canada Live - VP of Technology
Canada Mortgage and Housing - VP, Information & Technology
Canada Protection Plan - Head of IT
Canadian Depository for Securities - CIO
Canadian Direct Insurance - CTO
Canadian Payments Association - VP & CIO
Canucks Sports - Head of IT
Capgemini - Service Delivery Director
CAPREIT - CIO
Cardel Homes - VP MIS
Cargojet - CIO
CBI Health Group - CIO
CCS Corp. - VP IT
CDSPI - Board Director
Centerra Gold - Director IT & Comm
CI Global Asset Management - VP of Enterprise Infrastructure $amp; Operations
CIBC - Senior Director, Infrastructure Planning & Engineering
CIBC - SVP & CIO, Retail and Business Banking Technology
CIBC Mellon - AVP, Enterprise Architecture
CIBC Mellon - SVP & CIO
Cineplex Entertainment - CTO
City of Brampton - Senior Manager, IT Architecture & Planning
City of Richmond Hill - CIO
City of Toronto - Director of Strategic Planning & Architecture
CN Rail Service - Chief Information Security Officer
Coast Capital Savings - VP Technology
Colliers - Head of Technology & Data
Concordia University - AVP & CIO
Crescent Point Energy - Head of IT
Dairy Farmers of Ontario - Head of IT and Administration
Dale Parizeau Morris Mackenzie - VP, IT
Davies Ward Phillips & Vineberg LLP - Director, Information Technology
DealerTrack Canada - Director, Technology
Defence Construction Canada - Corporate Manager, IT
Deloitte - Director, Risk Advisory
Dentons - Canada CIO
Devon Energy - Director, Integrated Business Services
Direct Cash - VP IT & Security
Dynamic Tire Corp - CIO
D+H Partnership - VP, Head of Canadian Mortgage Technology
eHealth - EVP, Technology
eHealth Ontario - VP, IT Systems & Services
Encana - Director, InfoSec
Enbridge Inc. - VP, Technology and Information Services
Enerflex - CIO
Enerplus - VP. IS
ENMAX - VP, IT & PMO
Equitable Bank - CIO
Equitable Bank - CISO
Equity Financial Trust - VP, IT
Essential Energy Services - Director, IT
Expedia Cruise Ship Centers - VP IS
FGL Sports - VP, Information Technology
Finastra - SVP, Head Technology Managed Services
Fix Auto Canada - COO & SVP
Flightnetwork.com - CIO
Freedom Mobile - Head, Customer Applications, Experience, & Strategy
FT Services - CIO
FundServ - CIO
Genus Capital Management - CTO
Genworth Financial Inc. - VP IT
Geotab - Board Member
Golder Associates - CTO
Gran Tierra Energy - Director IT
Grant Thornton LLP - CIO
Grand River Hospital - Director, Data Governance & Analytics
Greenwin Inc - VP, Information Technology
Groupe Dynamite - Director, IT
GSK Canada - IT Director
GTAA - Acting CIO
H&R Block Canada - VP IT
Haventree Bank - VP, Technology
Hewitt Equipment Ltd. - VP & CIO
Hitachi Vantara - GVP & Global CTO
Home Trust Company - CIO
Home Trust Company - CTO
Home Trust Company - VP & CISO
Horizon North Logistics - CIO
HSB Canada - VP IT
IBM Canada - Associate Partner, Payments Industry
Indigo Books and Music - CIO
Interac Corp - Director, Platform Engineering
ivari - SVP & CIO
JP Morgan Chase Canada - Executive Director, Information Risk Management
Keyera Energy - Director, Information Technology
KFC Canada - CTO
KnowledgeOne - CIO
LaFarge Canada - Director, IT
Landmark Cinemas Canada - VP, IT
LAWPRO - CIO
LCBO - Director, Applications Systems
LCBO - SVP & CIO
Leisureworld Senior Care Corp - VP IS
Lifeguard Digital Health - Chief Security & Informatics Officer
Loblaw Companies Ltd - Senior Director, Customer Engagement Technology
London Drugs - GM IT
Loto-Quebec - Corporate Director, InfoSec
Magna International Inc - VP & Global Leader, IT (CIO)
Manulife - Global Head of Private Markets & Real Estate Technology
March Networks - VP Professional Services & CIO
MaRS Discovery District - Managing Director, Fintech and Commerce
McCain Foods Limited - Manager InfoSec
McInnis Cement - Director of Information Technology
Medical Pharmacies Group - VP, Information Technology
MEG Energy - Manager, Information Technology Solutions & Services
Metrolinx - EVP & CIO
Minto Group - VP IT
MMM Group - CIO
Montreal Police Service - CIO
Morguard Investments - CIO
Moulding & Millwork - CIO
MullenLowe Group - Global CIO
National Bank of Canada - Information Security Officer
National Capital Commission - Chief, IT infrastructure & Support Services
NHL Players' Association - Head, Security & Technology
Northbridge Financial Corp - CIO
OEC Group Canada - Vice President, Information Technology and Client solutions
ODAIA - CEO
Oildex - VP, Architecture & Infrastructure
OPTrust - AVP, Enterprise Data Services
Olympia Financial Group - CIO
OMERS - EVP, Data & Technology
OMERS - SVP IT
OMERS - SVP, Data & Advanced Analytics
Ontario Pension Board - CTO
Ontario Teachers' Pension Plan - SVP, Product & Delivery
Ontario Trillium Foundation - CIO
Osum Oil Sands Corp - Manager, IS
Ottawa Police Service - CIO
Pacific Western Transportation - CIO
Packers Plus - Global IT Director
Pason Systems - Manager, Digital Communications & Corporate IT
Patient News - CTO
Peel District School Board - CIO
Pengrowth Corp - Director IS
Penn West Exploration - Snr. Manager, IT Operations
Peterson Investment Group - Head of IT
PFB Corp. - CIO
Pizza Pizza - CIO & VP, IT
Precision Drilling - VP, IT
Precision Drilling - Director, IT Infrastructure & Security
PSP Investments - Snr. Director, Internal Audit & Business Infosec
Public Works and Government Services Canada - Director, IT Security Directorate
PwC - Managing Director, Real Estate Technology Advisory
Pythian - CTO
Qantas - Global CIO
Queen's University - Director, Information Technology
RBC Royal Bank - Head of Application Security, Data Protection & Security Consulting
RBC Royal Bank - VP, Technology Platforms & Risk Management
RBC Royal Bank - Global Cybersecurity VP
Regal Lifestyle Communities - CIO
Revera Inc. - CIO
Revera Inc. - Security Architect
Rheem Manufacturing - CISO & Enterprise Architect
Ricoh Canada - VP,IT
RioCan Property Services - VP IT
Roche - Head of IT Americas – Operations
Rogers Communications - SVP, Customer Experience IT
ROM - CIO
Russel Metals - VP,IS
Salvation Army Canada - Board Director
SCI Group - CIO
Scotiabank - Head, Systems Architecture & Platform Modernization
Scotiabank - VP - International Systems Technology
Scotiabank - Head, System Architecture & Platform Modernization
Scotiabank - Global Head, GBM Compliance & Transformation
Sears Canada - Divisional VP, Information Technology Services
Secure Energy Services - GM, IT
Shaw - Head, Customer Applications, Experience, & Strategy
Shaw Communications - VP, Technology Operations
Shaw Communications - Director, Risk Management
SMART Technologies - Director, IS Corporate Services
Smartcentres - Director IS, IT
SmartOne Solutions - President & CIO
Societe de Transport de Montreal - Division Head - Security and Compliance
Street Capital Financial - CIO
Sun Life Financial - AVP, Data & Business Intelligence Services
Sun Life Financial - VP Application Ops & Services
Sunco Communication - COO
Suncor Energy Inc. - Director, Application Portfolio Optimization, I&PM, Business Services
Symcor - CTO, VP Technology Services
Talisman Energy - SVP IT & Business Services
TD Bank - Enterprise Architect
Teknion - SVP, CIO
TELUS - Chief Security Architect
Tervita Corporation - VP, Information Technology
The Hudsons Bay Company - VP Technology
The Hudson's Bay Company - SVP & CIO
The Source - VP, Information Technology
TMX Group - CISO & Global Head of Infrastructure Services
Toromont Industries - VP & CIO
Toronto District School Board - Chief Technology Officer
Toronto Hospital for Sick Children - Director of Technology
Toronto Parking Authority - CIO
Toronto Police Services - CISO
Toronto Transit Commission (TTC) - Chief Enterprise Architect
Toronto Transit Commission (TTC) - CIO
Toyota Canada - National Manager, IS
Transamerica Life Canada - CIO
Trican Well Services Ltd. - Director, Business Information Systems
Tridel Corporation - CIO
Trillium Health Partners - IT Director, Applications & Clinical Informatics
UFA Cooperative - VP & CIO
University of Calgary - Executive Director, Development Services
University of Ottawa - CIO
University of Ottawa - Senior Director IT Services & Infrastructure
University of Toronto - Director, Centre for Management & Technology
University of Waterloo - Director, Technology Entrepreneurship
Valencia Risk - Managing Director
Vancity - VP Technology & Solutions
Viterra - Director Enterprise Technology
Wawanesa Mutual Insurance Company - Director of Innovation Outpost
World Health - Director IT
Wolseley Canada - CIO & COO
WSIB - Board Director
Yellow Pages Group - Director - Enterprise Data Management
York Region District School Board - CIO
York University - Board Director
Technology Archive
- ► 2024 (1)
- ► 2023 (1)
- ► 2022 (1)
- ► 2019 (3)
- ► 2018 (1)
- ► 2017 (2)
- ► 2016 (2)
- ► 2015 (1)
- ► 2014 (3)
- ► 2013 (5)
- ► 2012 (4)
Lessons from CrowdStrike on Safeguarding Your Data with Compliance, Continuity and Disaster Recovery Strategies.
Recently I went for my annual physical where my routine blood work gave me some interesting news.
Generative AI (GenAI) has captured the imagination of enterprises across the globe, with nearly all organizations recognizing it as a top-five priority. However, a recent report from 
