2,684
edits
INTEGRATE: Difference between revisions
m
→How does INTEGRATE treat overlaps?
mNo edit summary |
|||
| Line 34: | Line 34: | ||
The integration algorithm proceeds along the following lines: | The integration algorithm proceeds along the following lines: | ||
# the x,y,z, center of each pixel of the detector is assigned to its nearest (predicted) reflection in reciprocal space ("pixel-labelling", see [http://dx.doi.org/10.1107/S0021889888007903]). | # the x,y,z, center of each pixel of the detector (z corresponds to phi, and the z pixelsize is delta-phi) is assigned to its nearest (predicted) reflection in reciprocal space ("pixel-labelling", see [http://dx.doi.org/10.1107/S0021889888007903]). As a consequence, ''each pixel of the detector is used for at most one reflection''. | ||
# some of these pixels will mostly allow the background estimation, others will mostly contribute to the integration area (but as they are transformed into a local coordinate system [http://dx.doi.org/10.1107/S0021889888007903] there is not a 1:1 relationship). | # some of these pixels will mostly allow the background estimation, others will mostly contribute to the integration area (but as they are transformed into a local coordinate system [http://dx.doi.org/10.1107/S0021889888007903] there is not a 1:1 relationship). | ||
# for each reflection, the background is estimated, and the 3D profile is assembled from the pixels contributing to it. Pixels which are mostly background but whose counts are higher than expected (e.g. due to overlap) are rejected. | # for each reflection, the background is estimated, and the 3D profile is assembled from the pixels contributing to it. Pixels which are mostly background but whose counts are higher than expected (e.g. due to overlap) are rejected. | ||
# the average profile is formed on a grid by superimposition of strong reflections found in step 3. The signal part of the profile is defined by those gridpoints of the average profile that are above a threshold (called "CUT" in XDS.INP). | # the average profile is formed on a grid by superimposition of strong reflections found in step 3. The signal part of the profile is defined by those gridpoints of the average profile that are above a threshold (called "CUT" in XDS.INP). | ||
# not all pixels of a reflection, which would be required to assemble its full profile (whose shape is given by the average profile formed in step 4), may have been observed due to step 1. Therefore, in another pass, for each reflection, the observed fraction of its theoretical profile is calculated. If this fraction is less than a threshold (called "MINPK" in XDS.INP), this reflection will be discarded ("too much overlap"). If it is above MINPK, the observed intensity (from the incomplete profile) is scaled up with the inverse of the fraction | # not all pixels of a reflection, which would be required to assemble its full profile (whose shape is given by the average profile formed in step 4), may have been observed due to step 1. Therefore, in another pass, for each reflection, the observed fraction of its theoretical profile is calculated. If this fraction is less than a threshold (called "MINPK" in XDS.INP), this reflection will be discarded ("too much overlap"). If it is above MINPK, the observed intensity (from the incomplete profile) is scaled up with the inverse of the fraction. | ||
Among other things, this means that: | Among other things, this means that: | ||
* there is no conceptual difference in XDS between overlap | * there is ''no conceptual difference'' in XDS ''between overlap in x,y'' (due to too close detector, or smeared spots), ''and overlap by phi rotation'' (due to too large delta-phi, or high mosaicity). | ||
* the program does ''not'' look around each reflection to detect an overlap situation, it just gathers the pixels for each reflection. | * the program does ''not'' look around each reflection to detect an overlap situation, it just gathers the pixels for each reflection. | ||
* if two reflections differ in phi, but have the same position on the detector, then, as a consequence of step 1 the pixels are assigned to that reflection whose phi-calc is closest to the phi of the frame considered. The relative intensities of these reflections are not taken into account because at this stage they are unknown! Thus, no deconvolution is attempted. | * if two reflections differ in phi, but have the same position on the detector, then, as a consequence of step 1 the pixels are assigned to that reflection whose phi-calc is closest to the phi of the frame considered. The relative intensities of these reflections are not taken into account because at this stage they are unknown! Thus, ''no deconvolution is attempted''. | ||
* as a user, when your crystal-detector distance was chosen too low, or the reflections are very broad, or if the crystal has a high mosaicity (all of which result in many overlaps), you may try reducing MINPK down to some percentage between 75 and (say) 50. This will result in more completeness, ''but you should monitor the quality of the resulting data''. Conversely, if you raise MINPK above its default of 75 you will discard more reflections, but the resulting dataset may be cleaner - again: ''check the statistics''. | * as a user, when your crystal-detector distance was chosen too low, or the reflections are very broad, or if the crystal has a high mosaicity (all of which result in many overlaps), you may try reducing MINPK down to some percentage between 75 and (say) 50. This will result in more completeness, ''but you should monitor the quality of the resulting data''. Conversely, if you raise MINPK above its default of 75 you will discard more reflections, but the resulting dataset may be cleaner - again: ''check the statistics''. | ||
* this method degrades if the average profiles cannot be completey formed. This may happen if the reflections are too close in x,y and, at the same time, the mosaicity is high (such that no lunes exist, with edges that help constructing the average profiles). | * this method degrades if the average profiles cannot be completey formed, as the scaling-up relies on their accuracy. This may happen if the reflections are too close in x,y and, at the same time, the mosaicity is high (such that no lunes exist, with edges that help constructing the average profiles). ''It is therefore useful to check the printed profiles in INTEGRATE.LP''. | ||