Global TMW:
Login  |  Register          Free Newsletter Subscription
Subscribe
Email
Print
Reprint
Learn RSS

Detailed vision—Not all black or white

The images analyzed in inspection systems are moving away from simple high-contrast silhouettes and into complex gray-scale images.

Irene Leszkowicz, Matrox Imaging -- Test & Measurement World, 12/1/2004

Advanced automated optical inspection (AOI) and automated x-ray inspection (AXI) systems used as part of a production line are extremely adept at functional pass/fail, or flag, testing of dense complex assemblies of surface-mount components. If you need more than a pass/fail result, though, perhaps to quantify factors that may impact reliability, you may have to inspect components offline in a QA lab or at a development bench. Must you replicate the factory-floor vision system costing hundreds of thousands of dollars, or can you use something much more modest? Will you need the same image-analysis algorithms, or will a different set do?

Accuracy considerations
10x rule
In this two-part article, I'll describe some techniques commonly employed in AOI and AXI and compare them with more general-purpose image-analysis tools. Part 1 covers mature optical methods, while part 2, scheduled for April 2005, will explore the trend toward newer profile and x-ray techniques.

Read all of the Dec. 2004/Jan. 2005 features:

The Best in Test
Test & Measurement World's technical editors have chosen the 2005 Best in Test award winners.

DSM fault models
A combination of bridging, transition, and path-delay fault models helps manufacturers achieve optimal test coverage.

Detailed vision—Not all black or white
The images analyzed in inspection systems are moving away from simple high-contrast silhouettes and into complex gray-scale images.

Ethernet: Poised to go the distance
Ethernet in the First Mile could simplify networks and reduce costs. And most of the test infrastructure is already in place.

Image-analysis software plays key role

We have all witnessed the physical changes in electronic assemblies over the last 10 years. Increased densities came with surface-mount technology as through-hole components were replaced by quad flat packs (QFPs) bordered with very fine-pitch J leads. In the quest for more interconnects in a given footprint, technologies have evolved with connections on the underside of the package, hidden from the optical camera eye. These include ball-grid arrays (BGA, µBGA, PBGA) as well as flip chips and other "bumped" chip-scale packages (CSPs).

That same 10-year period also represents the typical amount of time it takes for a new software technology to progress from research labs and technical journals through high-end customer products and finally to more general commercial availability. Image-analysis software technology is nearing the end of such a 10-year stretch and is undergoing a final developmental stage: optimization, which involves converting critical portions into specialized processor instruction sets (MMX, SSE, or co-processor code) or into hardware-accelerated implementations.

Image-analysis software represents a key component of today's mature, sophisticated AOI systems. To inspect today's components and connections, advanced AOI systems bring to bear sophisticated motion control that positions programmable arrays of hundreds of vari-directional LEDs and up to five cameras, all with micron precision.

The cameras can provide a top view and oblique angle views of all four sides of any component. Ranging techniques measure any warpage in a board, for example, ensuring that optimal focus distances can be maintained at any location during a scan over the board. Accurate positioning of LEDs eliminates unwanted shadows and reflections.

Because AOI systems tightly control the illumination direction and camera angle, most assembly and solder defects can be detected through simple image-analysis operations performed in small "inspection windows" set up for each pin, gap, or joint. Table 1 lists some common defects and typical AOI approaches for detecting them.

These simple analysis techniques remain popular because they have been used for a long time and are trusted. Simple analyses can also be performed quickly, a trait that is essential for inspections of printed circuit boards.

Consider that a reliable inspection of very small components (0402 and 0201) and very fine-pitch QFPs requires an AOI system to capture at least 10 pixels across each feature. For large board sizes, therefore, a lot of pixels need to be captured and processed. Some manufacturers of AOI systems claim to collect and process over 100 Mbytes of image data per board. It becomes evident that speed of analysis is important. Applying hardware solutions to the problem—wider buses, higher bandwidths and multiple processors—can more readily speed up simple techniques than complex ones.

Catching solder-paste defects

By placing an AOI system after the soldering stage, a manufacturer can identify defects that would render a board nonfunctional. Some sources, in fact, suggest that 80% of defects are solder related (Ref. 1).

Other companies are looking to improve yield (percentage of boards that pass post-solder AOI and in-circuit testing [ICT] without rework) by trying to identify potential problems before the solder stage—that is, just after solder-paste deposition. They point to the 10x rule, which encourages defect detection as early as possible. Consequently, they use solder-paste inspection systems for early defect detection. (See "10x rule ," below.)

Defects have plenty of opportunities to creep into the highly mechanical process of forcing a sticky substance through the thousands of tiny holes in a silkscreen. Failure analysis has indicated that the critical parameters in deposited solder paste are its height and volume. An overhead camera can determine the area of the paste spot, and you can derive a height and volume measurement from the area based on assumptions about the shape of the spot, such as that it is a perfect hemisphere.

Area measurements

Typically, area calculations employ a standard technique, classifying pixels as either "background" or "object" based on their brightness (thresholding) and then counting the connected "object" pixels in a blob. The discretization errors of thresholding can be significant, especially in the presence of nonuniform lighting and at lower magnifications (see "Accuracy considerations ," below). Such errors in estimating volume can be overcome with more sophisticated edge-detection algorithms that have subpixel accuracy. Even with controlled lighting, sophisticated edge detection may allow a lower magnification to be used, which decreases the number of images required to cover the entire board and increases throughput.

An alternate inspection approach is to move beyond the 2-D image. Volume determination and other inspections (like determining the shapes of fillets on solder joints, the bumps on CSPs, and the balls on BGAs) have given rise to a number of "profilometry" systems that measure the height as well as the shape of objects protruding from a flat substrate.

 
Figure 1. Structured light in the form of a fan of laser light reflects from a flat surface as a straight line. However, viewed from a camera at an oblique angle, any raised surfaces cause portions of the line to appear to be deflected by an amount proportional to their height.
The most common technique uses structured light in the form of a fan of laser light. It reflects from a flat surface as a straight line. When viewed from a camera at an oblique angle, however, any raised surfaces cause portions of the line to appear to be deflected by an amount proportional to their height (Figure 1). Using some straightforward geometry, if the location and orientation of the light source, base plate, and camera are known, the height of the objects under the line can be computed.

Typically, the light scans over the entire board to build up a height map line by line. Frame grabbers with some onboard processing can do these calculations on the incoming data and can generate the height map in real-time. Profilometry approaches are sometimes classified as "21/2-D," because they only look at the upper surfaces of the components, rather than forming a complete 3-D representation of the board and components. Variations on this technique use multiple cameras to overcome problems of concavity and of tall components casting shadows. Interference patterns between two structured white light sources are sometimes used instead of laser illumination.

Of course, many PCBs today include solder connections invisible to any optical technique. Part 2 of this article (scheduled for April 2005) will examine the automated x-ray techniques that you can apply to inspect such connections.


Author Information
Irene Leszkowicz is the Group Leader for Interactive Imaging Software at Matrox Imaging, and has over 20 years of experience with the company. She holds a BEng in Electrical Engineering from McGill University and an MASc from the University of Toronto, and she is also an Adjunct Professor in Electrical and Computer Engineering at McGill University in Montreal. ileszkow@matrox.com.


REFERENCE
  1. Riddle, Mike, "Solder Paste Measurement: A Yield Improvement Strategy That Helps Improve Profits," SMT Express, May 17, 2001, www.smtnet.com/express/200105/paste/index.cfm.
 

Accuracy considerations

Variations in intensity can cause huge differences in simple analyses. In the figure, the rough outline shows the boundaries of the spots as determined by typical blob analysis working with binarized images.

The figure shows a tendency to underestimate the size of an area on a bright background and overestimate its size on a dark background. On a set of these unevenly lit spots, a measure of the convex perimeters gave a mean of 31.7, a standard deviation of 2.1, and a variance of 4.6.

More sophisticated edge-detection and extraction algorithms can produce the yellow curve—whereby the same sample of spots gave a standard deviation of 0.85 and a variance of 0.71. Considering the tight tolerances required in electronic assembly inspection, it is evident that if you don't have superbly controlled lighting and optical setups in your laboratory, you need to compensate through the use of more sophisticated analysis tools.

 

In the presence of uneven lighting, subpixel contours (yellow) provide better measurements of a target area than do threshold contours (blue).

     

10x rule

The 10x rule of thumb, usually credited to Barry Boehm, suggests that every stage down the production chain incurs a factor of 10 in the cost of repairing a defect. In software-development projects, the "cost" is usually hours of work to correct the defect (bug). The prospect of exponential cost growth also gives rise to the extensive use of vision systems at every stage of wafer production, after wire bonding to the lead frame and before encapsulating in the package. Board-level defects are sometimes reworked, and other times material is scrapped, giving two different kinds of costs. Obviously, it is cheaper to catch a problem at the manufacturing stage than at incoming inspection at a customer site or, even worse, once the product is installed in its end-use location.—Irene Leszkowicz

Email
Print
Reprint
Learn RSS

Talkback

We would love your feedback!

Post a comment

» VIEW ALL TALKBACK THREADS

Related Content

Related Content

 

By This Author

Sponsored Links



 
Advertisement
SPONSORED LINKS

More Content

  • Blogs
  • Podcasts

Blogs

  • Martin Rowe
    ROWE'S AND COLUMNS

    November 5, 2008
    Technical articles retain value
    I'm always amazed, and pleased, when I hear from readers who still find value in old T&MW articl...
    More
  • Martin Rowe
    Rowe's and Columns

    October 31, 2008
    Measurement proverbs
    The other day, I received some measurement proverbs that I'd like to share. The proverbs come from K...
    More
  • » VIEW ALL BLOGS RSS

Podcasts

Advertisements





NEWSLETTERS
Click on a title below to learn more.

Test Industry News (3 Times Per Month)
Machine-Vision & Inspection (Monthly)
Communications Test (Monthly)
Design, Test & Yield (Monthly)
Automotive, Aerospace & Defense (Monthly)
Instrumentation (Monthly)
Resource Center E-Alert (Monthly)
©2008 Reed Business Information, a division of Reed Elsevier Inc. All rights reserved.
Use of this Web site is subject to its Terms of Use | Privacy Policy
Please visit these other Reed Business sites