Haloscopes axion detectors with RF cavities have the advantage of signal enhancement. However, to scan at larger mass ranges, the cavity's physical dimension will scale unfavorably down with frequency, necessitating the use of multiple cavities to maintain the detection volume. Working with multiple cavities adds significant complexity to the detector because of the need to combine the output signal coherently from the multiple cavities after locking them together in frequency. We propose a multicell cavity implementation to face this challenge as an alternative. Multicell cavities are routinely used and employed in particle accelerators. Using a similar concept for axion haloscope detectors is quite appealing. In this paper, we introduce the concept and investigate its potential and challenges in the context of axion detectors.