Student Feedback on Federated Search Use, Satisfaction, and Web Presence: Qualitative Findings of Focus Groups

Several participants indicated that they use Search It in conjunction with other research tools. Some use Search It first to determine which databases would be best to search individually or just to see what is available, while others use Search It in parallel with other tools:

I use it [Search It] as my very first go-to … where’s the best [database] to search it, where’s the best [database] to get that information.

Just an additional thing I can use. Before I would use a social work or psychology database; now I might start with Search It to see what’s out there.

I use it along with something else [American Chemical Society resources].

[Search It] is my first choice library tool. But I still Google.

Satisfaction

When the participants were asked what they like about Search It, the most common response was that Search It broadened their horizons. This was mentioned in three sessions. One participant said, “I really like it because it pulls up a lot of little search engines I wouldn’t think of using database-wise. … It opens new doors that I didn’t realize were there.”

When the participants were asked what they dislike about Search It, the most common response was related to the reliability and logic of the results. This was mentioned in four sessions. One participant noted, “A lot of time the word I put in, it brings up off the wall topics.” A participant in a different session said, “Sometimes I feel that the results that come up are not necessarily relevant.”

The lack of instruction or documentation was another cause of dissatisfaction for participants in four sessions.

One participant asked if the library helped people use Search It because “I found out the hard way.” A participant in another session suggested that the library teach Search It in freshman-level general education courses, which is when she learned about the library.

Without prompting, several participants stated that they disliked the placement of the Quick Search box on the library homepage. This issue is discussed in greater detail in the next section.

When asked broadly whether Search It helped with an assignment or research project, a majority of the respondents answered affirmatively. Search It helped several participants generate new ideas, helped a couple of participants complete a comprehensive literature review, and helped other participants find reliable sources and research unfamiliar topics.

Website Integration

When the focus groups were conducted, the Quick Search box on the library homepage was located at the top of the right-hand column, as shown in figure 1. In all five sessions, participants commented that the placement on the right side was not ideal. In fact, some participants compared the placement to a calendar event or an advertisement. The colors used also received negative comments:

As far as the placement on the website goes, I find it could be better. … It’s almost like it’s a calendar event which is something not here to stay. … That green background kind of puts it in the background instead of focusing on it.

When you have a right column like that [with icons], most people automatically assume it is some sort or type of advertisement and most people … eliminate or forget that.

It just seems like it doesn’t stand out where it is on the side of the page. Same colors as with the bottom icons.

The participants did have suggestions on how to integrate Search It into the library website. The most common suggestion, which was mentioned in all five sessions, was to move the Quick Search box above or below the five main options in the middle of the homepage. Many participants felt this placement would make Search It more obvious and would make research easier, especially for inexperienced researchers who just need a place to start. One participant who had worked at the library reference desk commented that students who ask for help at the desk often do not know what type of material they want (e.g., books or articles) or how to search, so to help these students Search It should be as prominent as the catalog or database options on the homepage. Similarly, a participant in another session noted that the catalog and database options on the homepage are rather specific, and sometimes a user just needs somewhere to start. Therefore Search It should be “either above or below the five [main options].” On a related note, a few participants suggested using color to make Search It stand out in the middle of the page. One participant said that if Search It was placed in the middle of the page, a different color should be used, and a participant in another session suggested highlighting it in yellow to make it stand out.

When asked for ideas about what wording or graphics should be used, many participants suggested simple wording. Some of the suggestions were phrased as questions, while others were brief phrases.

Don’t know where to find it?

Try this.

Need a place to start?

One click gets it all.

Quick search your topic or idea.

The participants were also interested in having Quick Search boxes integrated into other university-related websites. Several participants agreed that Search It would be useful in the university portal and in learning management systems, such as Blackboard. A few participants also mentioned including a Quick Search box on department websites.

Discussion

Feedback from our focus group discussions is consistent with several key findings of previously published federated search research. Unique about our findings is that they come from actual federated search users, whereas most previous studies have relied on feedback from controlled tests. The few studies involving federated search users have used surveys. Our findings are based on lengthy in-person conversations.

As has been the case with previous research, the majority of our participants expressed satisfaction with our federated search tool. Unlike many of those previous studies in which respondents gave positive but qualified support to federated searching, our focus group participants offered strong support. When asked whether the library should continue to offer federated searching, all participants who commented urged the library to do so. A comment from one participant was typical, “Students would be better off with Search It than without it.” Whether that level of support would be found in our larger population of federated search users cannot be deduced from our qualitative study.

Pages: 1 2 3 4 5 6 7