InnerWeb
Skip to main content

How to plan a pilot: scope, timeline, KPIs

A well-planned pilot has one route or one area, a defined number of users, measurable indicators and a decision at the end that is described in advance. This guide takes the project coordinator through six steps that should be closed in writing before the order is signed, so that after a few weeks management receives data, not impressions.

Step 1: state the goal in one sentence

A pilot without a goal turns into a demonstration. Start with one sentence that says what should change and how you will know, for example: "We want to check whether the completeness of patrols on one route increases and whether the time to respond to a fault shortens compared with the current state". The sentence should contain a measurable quantity, not an adjective.

The goal depends on the audience for the results. The maintenance manager will ask about faults, the health and safety department about inactivity and permits, and security about the traffic of external contractors. If the goals differ, choose one for the pilot and record the others as candidates for extension.

Step 2: limit the scope to one area

The pilot can start at one facility under live traffic from external contractors, and the extension to further plants is planned only after the results are assessed. Similarly, the route-patrol pilot is based on one real route: about 100 BLE beacons, that is one per about 200 m2, at the control points, a mobile application that works offline, 3 mobile devices and an instance with 10 licences.

The inactivity detection pilot covers 50 BLE beacons, a server with licences for 10 users and LTE watches managed through MDM. Choose the variant that matches your goal and do not combine everything at once. Localisation results from signals of many beacons averaged on the map, and inside buildings we recommend one beacon per 100-200 m2, roughly every 100 m on site roads, without GPS.

Pilot scale: number of beacons by variant

Pilot scale: number of beacons by variantHorizontal bar chart: about 100 beacons in the patrol pilot and 50 beacons in the inactivity detection pilot.020406080100pcsPatrol pilot (1 route)Patrol pilot (1 route): 100 pcs100Inactivity detection pilotInactivity detection pilot: 50 pcs50
Source: Cards: route-patrol and inspection pilot, and inactivity detection pilot

Step 3: set the number of users and licences

The flexible licence counts Active Users: accounts with at least one login in a calendar month, with a minimum of 10 licences in billing. The count includes client employees with administrator, security and health and safety roles, and coordinators from external contractors. Visitors, contractor employees and drivers are not counted.

Prepare a list of roles and people who will log in during the pilot, and mark who will realistically log in each month. For most pilots 10 users are enough. If the list is longer, ask the vendor about billing before you send invitations.

Step 4: define the timeline and the closing event

A pilot can run with no fixed term, but the coordinator should still set a date for reviewing the results. The subscription starts from the month following go-live, so record the start of the assessment period as a concrete go-live date. A good practice is to divide the pilot into three periods: installation and training, work in the normal rhythm, and review and decision.

The closing event is a meeting at which you present the final report and ask for one of three decisions: moving to deployment, extending the pilot or closing it. Without such an event an open pilot can run for months without a conclusion.

Step 5: choose the success indicators

The route-patrol pilot measures the completeness of patrols and the time to respond to a fault, and the morning report shows the manager the effect from the first day. This is a good example of a set: two quantities that can be read from the system without manual counting, plus a report visible from day one, which builds trust among users.

For each indicator record three items: the baseline value, the target value and the measurement method. Measure the baseline before the start or in the first week, and set the target with the person responsible for the process. Avoid indicators that cannot be read from the system, because at the review they will become a matter of dispute.

  • Completeness of patrols on the pilot route.
  • Time to respond to a reported fault.
  • Number of users active in the month.
  • Number of reports and tasks closed on time.

Step 6: plan the data for the production decision

The decision documentation for moving to production shows pilot data, for example stage times and routes per warehouse, as justification. Plan from the start which reports you will export at the end and who will describe them. After the pilot, the devices used in it can be transferred to ownership on a one-to-one basis, which is worth including in the budget of the decision.

In past InnerWeb projects, the move from pilot to production deployment reached 100%. This is information about the past, not a guarantee: the deployment at your site will be decided by your indicators and your management board.

Video

Frequently asked questions

How long should a pilot last?

A pilot can run with no fixed term, but it is worth setting a review date and a closing event with a decision. Adjust the length to the work cycle in the pilot area.

How many users does a pilot need?

The billing minimum is 10 licences. What counts is Active Users, meaning accounts with at least one login in a calendar month.

Which indicators should I choose?

In the route-patrol pilot the completeness of patrols and the time to respond to a fault are measured. Choose quantities read from the system, with a baseline and a target value.

Do we have to start with the whole site?

No. You can start with one facility or one route and plan the extension after assessing the results.

Let's plan a pilot for your site

Book a conversation with InnerWeb: we will help you select the scope, the number of users and the pilot success criteria for your hall or route.

Let's talk